Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever
Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Cennydd Bowles
Day 1 Panel
2024 • Designing with AI 2024
Gold
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Dr. Jamika D. Burge
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Daniel Gloyd
Designing From the Inside Out: How Method Acting Can Inspire Design Research
2026 • Rosenfeld Community
Steve Portigal
War Stories LIVE! Q&A-Discussion
2020 • Advancing Research 2020
Gold
Marisa Bernstein
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
2021 • Civic Design 2021
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Robin Beers
Beyond Insights: Researchers as Organizational Change Catalysts
2024 • Advancing Research 2024
Gold
Bianca Jefferson
From Sprints to Systems: Operationalizing Continuous Discovery Through DesignOps
2025 • DesignOps Summit 2025
Gold
Fisayo Osilaja
[Demo] The AI edge: From researcher to strategist
2024 • Designing with AI 2024
Gold
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Dave Hora
Research in the Face of Complexity: New Sensibility for New Situations
2025 • Rosenfeld Community
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold

More Videos

Marissa Cui

"We built a carbon removal dashboard that turned complex data into immersive stories accessible to general audiences."

Marissa Cui Rachel He Michael Leggett Manos Saratsis

Climate Design Product Showcase

March 13, 2024

Ryan Rumsey

"Being on time and on budget with your first projects is one of the most powerful trust-building levers."

Ryan Rumsey

Business Influence Without Losing Your Soul

January 14, 2021

Aditi Ruiz

"Capturing quotes directly—even assumed ones—makes empathy mapping more specific."

Aditi Ruiz Christian Crumlish Farid Sabitov

A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1

December 6, 2022

Chris Moses

"Using work structure as a taxonomy for knowledge failed due to frequent reorganizations; switching to a jobs-to-be-done taxonomy gave us stability."

Chris Moses

Stretching the Definition of DesignOps with Product Development

November 7, 2018

Joshua Graves

"Sometimes, avoiding the conversation feels easier but can have bigger costs than facing it."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Steve Portigal

"Breaking enterprise into small segments lets you apply research methods effectively at scale."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Gillian Salerno-Rebic

"There’s an opportunity to fill in cracks around a research practice and accelerate the work people already do."

Gillian Salerno-Rebic Mark Micheli

Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation

June 10, 2025

Margot Bloomstein

"Vulnerability in communication — admitting what you don't know — is a strength that builds trust."

Margot Bloomstein

Fostering Trust in Your Brand and Beyond

March 12, 2020

Megan Blocker

"An insight repository curated thoughtfully and powered by generative AI makes research accessible anytime with trusted references."

Megan Blocker Marieke McCloskey Renee Reid

Positioning insight: Structuring teams, roles and careers for a changing research landscape

March 13, 2025