Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.
-
•
Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.
-
•
Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.
-
•
Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.
-
•
The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.
-
•
Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.
-
•
Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.
-
•
Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.
-
•
Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.
-
•
Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.
Notable Quotes
"Research is a sales role at its heart, delivering value to people to drive sustainable growth."
"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."
"We don’t have dedicated user researchers, but designers and PMs conduct most research here."
"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."
"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."
"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."
"I want to encourage excitement about research and gradually mold people into better researchers."
"Sometimes you have to make it messy before it can be clean again — disrupt to improve."
"We have the quantity of research work; now we’re focused on building up the quality."
"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."
Or choose a question:
More Videos
"We mostly have something called a BYOE scenario or bring your own ethics."
George AyeThat Quiet Little Voice: When Design and Ethics Collide
November 16, 2022
"You either give money as an unprofessional civilian or you do your job and offer professional services to help the crisis."
Xenia Adjoubei Sean BruceEmpowering Communities Through the Researcher in Residence Program
March 29, 2023
"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."
Benjamin Wiedmaier Annie MayfieldRedefining Toolkits: Unbundling to Create a Perfect Match
March 11, 2025
"There’s quantitative ways of driving value and qualitative aspects, but we have to break it down into what kind of value we’re aiming at."
John DevanneyThe Design Management Office
November 6, 2017
"The Netflix grid experience that was simplest and offered no genre picking actually won, showing users are lazier than they think."
Steve Sanderson Alissa Briggs Jeff Gothelf Bill ScottDiscussion
May 14, 2015
"VB Rosenstein scaled Zendesk’s global UX research practice while adding rigor and credibility to their work."
Jemma AhmedTheme 2 Intro
January 8, 2024
"Our jobs as researchers isn’t really to do research. It’s to influence people and help them make decisions."
Megan KiersteadYou Are a Badass at UX: Overcoming Imposter Syndrome
March 10, 2021
"Instead of choosing colors then checking contrast, we flipped the process and started by defining contrast ratio targets and then generating colors to meet them."
PJ Buddhari Nate BaldwinMeet Spectrum, Adobe’s Design System
June 9, 2021
"Vanity metrics like membership numbers don’t tell you if the community is healthy."
James LangIf you can design an app, you can design a community
May 22, 2025
Latest Books All books
Dig deeper with the Rosenbot
Why do Survicate's researchers prefer starting with low-fidelity prototypes before high-fidelity?
What strategies motivate cross-functional teams to input their research findings into a centralized repository?
Why is human storytelling stewardship still essential despite advances in AI and research democratization?