Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.
-
•
Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.
-
•
Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.
-
•
Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.
-
•
The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.
-
•
Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.
-
•
Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.
-
•
Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.
-
•
Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.
-
•
Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.
Notable Quotes
"Research is a sales role at its heart, delivering value to people to drive sustainable growth."
"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."
"We don’t have dedicated user researchers, but designers and PMs conduct most research here."
"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."
"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."
"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."
"I want to encourage excitement about research and gradually mold people into better researchers."
"Sometimes you have to make it messy before it can be clean again — disrupt to improve."
"We have the quantity of research work; now we’re focused on building up the quality."
"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."
Or choose a question:
More Videos
"Without trust, no relationship can prosper, yet many companies still install tracking software that employees try to circumvent."
Ana FerreiraDesigning Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
January 8, 2024
"Some people said I don’t think I’m qualified enough to observe research sessions despite training."
Roy Opata OlendeHow Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
August 6, 2020
"Growth boards are a more advanced tool that require breaking down walls between disciplines and focusing on outcome-driven metrics."
Kit Unger Jackie Ho Veevi Rosenstein Vasileios XanthopoulosTheme 2: Discussion
January 8, 2024
"Target’s internal teams varied in design maturity from totally nonexistent to full design strategy, so we had to meet them where they were."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"AI has no understanding of consequences — humans are the ones to bring that understanding."
Helen ArmstrongAugment the Human. Interrogate the System.
June 7, 2023
"Film is not just a way to capture information, it’s a way to think about information."
Bas Raijmakers, PhD (RCA) Charley Scull Prabhas PokharelWhat Design Research can Learn from Documentary Filmmaking
March 11, 2022
"Make sure children understand they can stop the session at any time, and confirm they really get that."
Mila Kuznetsova Lucy DentonHow Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
March 9, 2022
"ChatGPT has a big advantage in being thorough and comprehensive, especially compared to myself."
Weidan LiQualitative synthesis with ChatGPT: Better or worse than human intelligence?
June 4, 2024
"SAFe often turns UX into just digital or visual designers, which is wasteful and marginalizes valuable skills."
Christian CrumlishAMA with Christian Crumlish, author of Product Management for UX People
March 24, 2022
