Scaling Research Via an Ops First Model at Clever
Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.
-
•
Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.
-
•
Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.
-
•
Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.
-
•
The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.
-
•
Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.
-
•
Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.
-
•
Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.
-
•
Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.
-
•
Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.
Notable Quotes
"Research is a sales role at its heart, delivering value to people to drive sustainable growth."
"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."
"We don’t have dedicated user researchers, but designers and PMs conduct most research here."
"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."
"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."
"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."
"I want to encourage excitement about research and gradually mold people into better researchers."
"Sometimes you have to make it messy before it can be clean again — disrupt to improve."
"We have the quantity of research work; now we’re focused on building up the quality."
"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."
Or choose a question:
More Videos
"Mastery means information is a strategic asset with quantifiable equity central to business identity and operations."
Bram WesselEnterprise Information Architecture
January 10, 2020
"Career growth isn’t just vertical but also horizontal development in design skills."
John DevanneyThe Design Management Office
November 6, 2017
"If you really want to make things happen, you need to be in the room where it happens."
Rich MironovHow Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
December 6, 2022
"The curse of hyper-focus means you lose peripheral vision and miss the larger context and customer needs."
Malini RaoLessons Learned from a 4-year Product Re-platforming Journey
June 9, 2021
"Recycling is not always intentional; often insights emerge accidentally when revisiting old data with new perspectives."
Iulia CornigeanuQuantQual Book Club: Small Data
March 8, 2024
"Sounding authentically like you, while professional, is more engaging than robotic business writing."
Bruce GillespieLearning from journalism: Balancing impactful communication with compassionate storytelling
March 13, 2025
"Advancement in design maturity requires a tight business partnership between product management and design ops leaders."
Rima Campbell Amrit S BhachuIncrease Productivity and Drive Business Impact
September 24, 2024
"LLMs don’t have memory, so rating on a scale from one to five is pretty random. Better to have yes or no answers."
Peter Van DijckHands-on AI #2: Understanding evals: LLM as a Judge
October 15, 2025
"Storytelling has the power to disrupt hegemonic narratives and open space for people to be authors of their own stories."
Bilan HashiThe Tension Between Story Collecting and Story Telling in Research
March 10, 2021
Latest Books All books
Dig deeper with the Rosenbot
What are effective ways to train AI models to reduce hallucinations and glossing over details in taxonomy building?
What challenges do AI hallucinations present, and how should designers handle factual reliability?
What is the impact of disposable AI prototypes ('promptotypes') on team collaboration?