Rosenverse
Scaling Research Via an Ops First Model at Clever

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever

Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • •

    Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • •

    Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • •

    Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • •

    Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • •

    The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • •

    Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • •

    Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • •

    Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • •

    Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • •

    Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Sara Conklin
A UXer’s 12-Month Journey from Climate Concern to Climate Credibility
2025 • Climate UX Interest Group
Sharon Bautista
Time to Make the Donuts: How User Research Helped Bridge Disparate Teams
2024 • Enterprise Experience 2020
Gold
Billy Carlson
Tips to Utilize Wireframes to Tell an Effective Product Story
2023 • Enterprise UX 2023
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • Advancing Service Design 2025
Gold
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Katie Johnson
Disrupting generative AI products with just-in-time consumer insights
2024 • Designing with AI 2024
Gold
Jake Burghardt
Stop wasting research: Create new value with insight summaries
2025 • Rosenfeld Community
Doug Powell
DesignOps and the Next Frontier: Leading Through Unpredictable Change
2025 • DesignOps Summit 2025
Gold
Phil Hesketh
Designing Accessible Research Workflows
2021 • DesignOps Summit 2021
Gold
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
George Aye
Designing a New Social Contract
2026 • Rosenfeld Community
Anupama Dhareshwar
From blueprint to bot: Designing resilient AI-powered services
2025 • Advancing Service Design 2025
Gold
Rikki Teeters
Concept to code: Transforming ideas into functional products with Kiro
2026 • Rosenfeld Community
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold

More Videos

Abby Covert

"I want my collaboration tool to be like the Nest thermostat of my workday, knowing when I’m heads down and when I’m open to communication."

Abby Covert Tomer Sharon

Panel: Collaboration Tools

November 6, 2017

John Cutler

"Executives only like things in threes, but if you do a three by three, you can get away with nine boxes—that's the max executive information processing."

John Cutler

The Alignment Trap

November 29, 2023

Erika Flowers

"Focus on the destination, not the vehicle, because AI tools will change every single day."

Erika Flowers

AI-Readiness: Preparing NASA for a Data-Driven, Agile Future

June 10, 2025

Alla Weinberg

"Connection means feeling seen, heard, and valued; that’s what creates psychological safety."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Dan Donald

"Design systems are not a straight jacket, they free you from repetitive work to focus on bigger problems."

Dan Donald

Design Systems as a Vehicle for Systemic Change

June 1, 2023

Bria Alexander

"The official conference time zone is Pacific Standard Time, but you can change it to your own time zone at designatskill.com."

Bria Alexander

Opening Remarks

June 9, 2021

Carol Scott

"Trauma is a universal human experience."

Carol Scott Melissa Eggleston

Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices

February 5, 2025

Jessica Norris

"I’m ADHD. I’ve never spoken so publicly about this before."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022

Kyria Stephens

"Gunshots were a routine sound growing up. We became numb to it."

Kyria Stephens Marlon Kerner

Power to Heal: Civic Design in the Aftermath of Tragedy

November 17, 2022

Latest Books All books