Rosenverse
Scaling Research Via an Ops First Model at Clever

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever

Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Frances Yllana
D.E.A.R.R. Diaries (Discipline, Experience, Architecture, Reflection + Revolution)
2022 • Civic Design 2022
Gold
Peter Morville
The Architecture of Understanding
2015 • Enterprise UX 2015
Gold
Gordon Ross
12 Months of COVID-19 Design and Digital Response with the British Columbia Government
2021 • Civic Design 2021
Gold
Bill Scott
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
2015 • Enterprise UX 2015
Gold
Doug Powell
Closing Keynote: Design at Scale
2018 • DesignOps Summit 2018
Gold
Jon Fukuda
All the Ops: Successful cross-functional collaboration
2025 • DesignOps Summit 2025
Gold
Dave Hora
Advice for Establishing Research
2022 • Advancing Research Community
Bria Alexander
The Big Question about Resilience: A panel discussion
2024 • DesignOps Summit 2024
Gold
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Sean Dolan
A Practical Look at Creating More Usable Enterprise Customer Journeys
2019 • Enterprise Community
Dave Gray
Liminal Thinking: Sense-making for systems in large organizations
2015 • Enterprise UX 2015
Gold
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Craig Villamor
Design Systems for Ethical Design
2023 • Enterprise Community
Kate Stern
Scaling Learning for the Future
2022 • DesignOps Summit 2022
Gold
Harry Max
Prioritization for Leaders (2nd of 3 seminars)
2024 • Rosenfeld Community

More Videos

Jess Greco

"People make assumptions about what we can achieve through no fault of our own."

Jess Greco

Claiming your power: Practical tools for amplifying your unique voice

March 13, 2025

Josh Clark

"The prompt becomes part design spec, part requirement doc, and part programming language."

Josh Clark Veronika Kindred

Sentient Scenes and Radically Adaptive Experiences

June 11, 2025

Aleksandra Korczynska

"It's almost impossible to do a survey without using some kind of tool nowadays."

Aleksandra Korczynska Caroline Jarrett Justyna Parmee

Survey Tools

March 12, 2026

Anat Fintzi

"When I started, the team didn’t understand what the point of UX on the back end was; I had to win their hearts and minds."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Peter Morville

"When we understand organizations as ecosystems, we recognize the need for organic simplicity."

Peter Morville

The Architecture of Understanding

May 13, 2015

Paul Ford

"Are we an agency that is also kind of a product? Is the agency a product? The product an agency? We’re an agenuct? No, pragency."

Paul Ford

New work, new words: A glossary for AI

June 9, 2026

Ariel Kennan

"We want to deepen equity and care in how we work, who we do it with, and the output and impact it generates."

Ariel Kennan

Theme Two Intro

November 17, 2022

James Rampton

"If you’re concerned about cybersecurity, buy a used car with fewer electronic features or one that has a strong reliability score."

James Rampton

The Basics of Automotive UX & Why Phones Are a Part of That Future

July 25, 2024

Michaela Mora

"People care not about product features but what these features do for them."

Michaela Mora

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions

March 11, 2022