Rosenverse
Scaling Research Via an Ops First Model at Clever

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever

Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • •

    Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • •

    Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • •

    Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • •

    Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • •

    The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • •

    Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • •

    Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • •

    Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • •

    Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • •

    Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Darian Davis
Lessons from a Toxic Work Relationship
2024 • Enterprise Experience 2020
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Mike Oren
Design Research Strategy & Strategic Design Research
2022 • Advancing Research Community
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group
Prerna Makanawala
Achieving Balanced Design Consistency
2021 • Design at Scale 2021
Gold
Jack Moffett
SAFe or Sorry?
2019 • Enterprise Community
Jemma Ahmed
Bringing together market and user research
2019 • Advancing Research Community
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Jemma Ahmed
Convergent Research Techniques in Customer Journey Mapping
2020 • Advancing Research 2020
Gold
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold
Dan Donald
Design Systems as a Vehicle for Systemic Change
2023 • DesignOps Community
Amber Knabl
Empowering innovation: The critical role of inclusive product development in the AI era
2024 • Designing with AI 2024
Gold
Nathan Curtis
Discussion
2016 • Enterprise UX 2016
Gold

More Videos

Dr. Karl Jeffries

"I was talking with a person who said I’m like an idea machine, a 24-7 idea machine. The reply was immediate. It isn’t, you get used up and spat out."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"Creating internal champions in client organizations helps improve adoption and reduces churn."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Pilot projects with evangelists inside the company make ethnography manageable and successful."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"Some needs proved full-time, so hybrid staffing models are often short term or mixed part-time."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"For the right audience, if applied correctly, humor and music can move people in many ways."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"The ultimate measure is bringing value so people invite you back to work with them again and again."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"Choosing a research repository is a big battle in your organization; the right decisions can really help you succeed."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"The incentive structure at a big company is set up to reward people for entirely different stuff than innovation requires."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"Marketing is an essential collaborator because they help package and communicate insights organization-wide."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books