Rosenverse
Scaling Research Via an Ops First Model at Clever

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever

Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps Summit 2024
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Luke Wroblewski
Designing AI Applications
2026 • Rosenfeld Community
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Richard Buchanan
Creativity and Principles in the Flourishing Enterprise
2018 • Enterprise Experience 2018
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Michelle Chin
The DesignOps Starter Kit
2021 • DesignOps Summit 2021
Gold
Amber Knabl
Empowering innovation: The critical role of inclusive product development in the AI era
2024 • Designing with AI 2024
Gold
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Charting the future of DesignOps: A community workshop
2024 • DesignOps Community
Shreya Dhawan
Making service tangible: the fastest path to higher performance
2025 • Advancing Service Design 2025
Gold
Ashley Sewall
Exit Interview #5: Designing My Life After Tech
2026 • Rosenfeld Community
Joi Freeman
A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
2020 • Advancing Research 2020
Gold
Amy Jiménez Márquez
The Atypical UX Manager Path
2020 • Enterprise Community

More Videos

Deanna Mitchell

"Conversational analysis is not about replacing human understanding, it’s about amplifying it."

Deanna Mitchell

Designing with culture: Unlocking impactful insights for Product and UX

March 12, 2025

Adam Cutler

"Culture eats strategy for breakfast, but culture isn’t something you can just buy or transplant."

Adam Cutler

People + Places + Practices = Outcomes

June 8, 2016

Sam Proulx

"When blind users choose between Android and iPhone, they weigh trade-offs between stability and customizability."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Shazia Ali

"Reading unfamiliar news content helps you see structure and language more clearly than reading what you already care about."

Shazia Ali Bruce Gillespie Joyce Lee Andy Warr

Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]

August 21, 2024

Bria Alexander

"We help each other, support each other, and guide each other through murky and unclear times."

Bria Alexander

Theme Two Intro

September 8, 2022

Saara Kamppari-Miller

"We want everyone adopting these inclusive design and research practices—not just a few advanced teams."

Saara Kamppari-Miller

Inclusive Design is DesignOps

September 29, 2021

Louis Rosenfeld

"Nobody really knows what all this AI stuff is about yet, so we’re experimenting with it ourselves."

Louis Rosenfeld Peter Van Dijck

GenAI for UXers: A Rosenbot Demo and Discussion

September 11, 2025

Ovetta Sampson

"Design is the conscious and intuitive effort to impose meaningful order to chaos."

Ovetta Sampson

Research in the Automated Future

March 11, 2022

Lisa Spitz

"Participants can skip any questions they don’t feel comfortable answering; most demographic questions are optional to respect privacy."

Lisa Spitz Nikki Brand

Building Trust Through Equitable Research Practices

November 18, 2022