Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.
-
•
Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.
-
•
Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.
-
•
Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.
-
•
The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.
-
•
Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.
-
•
Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.
-
•
Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.
-
•
Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.
-
•
Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.
Notable Quotes
"Research is a sales role at its heart, delivering value to people to drive sustainable growth."
"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."
"We don’t have dedicated user researchers, but designers and PMs conduct most research here."
"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."
"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."
"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."
"I want to encourage excitement about research and gradually mold people into better researchers."
"Sometimes you have to make it messy before it can be clean again — disrupt to improve."
"We have the quantity of research work; now we’re focused on building up the quality."
"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."
Or choose a question:
More Videos
"Storytelling helps surface machine quirks and failures that aren't documented—AI as assistant ethnographer has great potential."
Ben Reason Aline Horta Majid Iqbal Fabiano LeoniMaking the system visible: The fastest path to better decisions
November 20, 2025
"The tools on mobile are free and built-in, unlike desktop where accessibility tools often require licenses and procurement."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
March 10, 2022
"Our monthly voice of the customer reports we call Stories in Dovetail; we share them with the team every month."
Anna Nguyen Emily BroganWhy Our Voice of the Customer is Better Than Yours
March 10, 2022
"A lot of these tools bring more noise into people’s day to day lives. It’s really hard to stay involved and still find time to get your own job done."
Abby Covert Tomer SharonPanel: Collaboration Tools
November 6, 2017
"The web content accessibility guidelines emphasize thinking about different ways people interact with our content."
Phil HeskethDesigning Accessible Research Workflows
September 29, 2021
"84% of website contributors didn’t know their own top pages or important analytics."
Irina Tikhonova Kari DietrichSmall Wins, Big Impact: Leveraging and Elevating User Engagement
December 9, 2021
"The new B Corp standards require companies to do policy advocacy, end of story."
Tim FrickThe journey of building a sustainable design practice
April 23, 2025
"We could impact the end-to-end customer service and customer experience through our most underutilized asset: our store employees."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021
"As a young Black man with long hair entering traditional civic spaces, I had to prove my authority through support from leaders like the mayor."
Justin Entzminger Terrance Smith Tracy M. Colunga Mai-Ling GarciaRisk and Reward: How to Diversify the Field of Civic Innovators and Designers
November 17, 2022
