Rosenverse
UX Research Excellence Framework

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework

Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • •

    A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • •

    Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • •

    An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • •

    Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • •

    Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • •

    Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • •

    Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • •

    Ethics should be embedded as a core value both in research operations and project prioritization.

  • •

    Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • •

    Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Dave Gray
Connection, Community, and the Future of Work
2026 • Rosenfeld Community
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Matt Bernius
Trauma-informed Research: A Panel Discussion
2021 • Advancing Research Community
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Aletheia Delivre
New Shapes and Emerging Identities for Design Ops
2025 • DesignOps Summit 2025
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Christian Crumlish
AMA with Christian Crumlish, author of Product Management for UX People
2022 • Enterprise Community
Yulya Besplemennova
[Demo] Stress-testing GenAI in user research synthesis
2024 • Designing with AI 2024
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Gillian Salerno-Rebic
Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation
2025 • Designing with AI 2025
Gold
Charlotte Vorbeck
Pipeline to Civic Design
2021 • Civic Design 2021
Gold
Leah Buley
Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
2024 • Rosenfeld Community
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold

More Videos

Bud Caddell

"There’s still folks who are entering saying I’m a team of one, no one knows what I do."

Bud Caddell Kristin Skinner Alana Washington

DesignOps Community Sensing Session

May 13, 2021

Dean Broadley

"The end of history illusion is that we think we're done evolving, but we vastly underestimate future change."

Dean Broadley

Not Black Enough to be White

January 8, 2024

Sarah Barrett

"The intellectually honest answer to most questions about information architecture is, I’m not sure, or it depends."

Sarah Barrett

The "How" of Enterprise Information Architecture

June 6, 2023

Sam Ladner

"It’s important to put the participant at ease and not add to their cognitive burden."

Sam Ladner Megan Blocker Tanvi Dhond Katie Hansen Ricardo Martins

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]

September 4, 2024

Patrick Neeman

"There’s going to be fewer players in AI, and that power differential is huge."

Patrick Neeman Jeffrey Zeldman

Agent Standards Best Viewed in Every Assistant

September 4, 2026

Aras Bilgen

"We need to reposition researchers so stakeholders see them as strategic advisors, not just data collectors."

Aras Bilgen Ari Zelmanow

Research Democratization: A Debate

March 29, 2023

Bram Wessel

"There was a naive belief that just implementing content management systems would automatically make great experiences possible."

Bram Wessel

Enterprise Information Architecture

January 10, 2020

Llewyn Paine

"Now a year later, the landscape is completely different with dozens of new AI design tools for all stages."

Llewyn Paine

Day 1 Using AI in UX with Impact

June 10, 2025

Jen Cardello

"The insights to action ratio tracks how many insights are acted upon, providing measurable impact."

Jen Cardello Dr. Shadi Janansefat Alex Wright

Curating insight: Strategies for integrating knowledge across research functions

March 11, 2025

Latest Books All books