Rosenverse
Scaling Research Via an Ops First Model at Clever

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever

Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • •

    Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • •

    Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • •

    Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • •

    Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • •

    The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • •

    Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • •

    Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • •

    Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • •

    Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • •

    Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Marjorie Stainback
What Research Ops Professionals Have Learned from COVID-19
2020 • Advancing Research Community
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Melissa Schmidt
How UX Research Hit It Big in Las Vegas
2019 • Enterprise Experience 2019
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Steve Turbek
Designing Interactive Graphics with AI Code Help
2026 • Rosenfeld Community
Tim Frick
The journey of building a sustainable design practice
2025 • Climate UX Interest Group
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
James Lang
Hopeful Futures for UX Research
2026 • Rosenfeld Community
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Uday Gajendar
Day 2 Welcome
2024 • Designing with AI 2024
Gold
Rachael Dietkus, LCSW
Trauma-Responsive Design: Reimagining the Future of Design Now
2021 • Civic Design 2021
Gold
Erin Weigel
Real-world lessons to improve your conversion rates
2024 • Rosenfeld Community
Cassandra Piester
Developing and Deploying Your Design Operations Strategy
2024 • DesignOps Summit 2024
Gold
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold

More Videos

Shipra Kayan

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Daniel Gloyd

"We don’t thrive individually or collectively without the warmth that emerges from meaningful connection."

Daniel Gloyd

Transcendent Experience (ZX) Design: A Design Framework for Human Connection

August 6, 2026

Erin Weigel

"There are as many versions of the website as stars in the sky because of language, currency, and device variations."

Erin Weigel

UX Lessons from running more than 1,200 A/B Tests

July 10, 2024

Onur Kocan

"Political parties at the provincial level have their own mandates, which complicates unified service design."

Onur Kocan Ayhan Ensici

Understanding the Strategy for Civic Design in a Complex City: Istanbul

November 16, 2022

Megan Campos

"Age carries with it obvious visible differences and lived experience, while race often involves less visible but equally impactful structures."

Megan Campos

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research

March 12, 2021

Jennifer Fraser

"Everything everyone knows is only a model. It’s important to get our models out there where they can be challenged."

Jennifer Fraser

What would Emmy Noether Do? Math, Models and Mulling in UX Research

March 29, 2023

Sofia Quintero

"There are almost two languages in organizations: what we say and what we really mean."

Sofia Quintero

Beyond Tools: The Messy Business of Implementing Research Repositories

March 10, 2022

Jemma Ahmed

"By bringing truth to power is how we bring excellence to our craft and define our value."

Jemma Ahmed

Theme 2 Intro

March 26, 2024

Jennifer Kanyamibwa

"Resiliency is not really a professional thing. It's actually a lot more personal."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018