Rosenverse
UX Research Excellence Framework

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework

Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • •

    A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • •

    Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • •

    An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • •

    Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • •

    Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • •

    Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • •

    Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • •

    Ethics should be embedded as a core value both in research operations and project prioritization.

  • •

    Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • •

    Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
George Hinchliffe
Delivering Amazing Experiences
2021 • Design at Scale 2021
Gold
Sarah Fathallah
Lessening the Research Burden on Vulnerable Communities
2020 • Advancing Research 2020
Gold
Maria Taylor
Knowledge is Power: Managing the Lifeblood of the Design Org
2023 • DesignOps Summit 2023
Gold
Jeff Sussna
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Kaitlin Tasker
Fast and Fearless Inclusive Research
2023 • Advancing Research 2023
Gold
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group
John Calhoun
Have we Reached Our Peak? Spotting the Next Mountain For DesignOps to Climb
2021 • DesignOps Summit 2021
Gold
Christian Crumlish
The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…
2025 • Rosenfeld Community
David Cronin
Discussion
2015 • Enterprise UX 2015
Gold
Sara Asche Anderson
Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
2024 • Enterprise Experience 2020
Gold
Phil Hesketh
Designing Accessible Research Workflows
2021 • DesignOps Summit 2021
Gold
Tina Weisser
When AI Agents Meet Reality. Service Design Lessons from a Pilot
2026 • Rosenfeld Community
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Jessamyn Edwards
Surviving Your UX Career in Enterprise Design
2021 • Enterprise Community
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Maria Giudice
Remaking the Making Company: Moving from Product to Experience
2016 • Enterprise UX 2016
Gold

More Videos

Shipra Kayan

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Daniel Gloyd

"Language gives us the words to talk about warmth, and that’s the birth of these ideas spreading within organizations."

Daniel Gloyd

Transcendent Experience (ZX) Design: A Design Framework for Human Connection

August 6, 2026

Erin Weigel

"Compound effect means good upon good upon good eventually builds to incredibly fast growth."

Erin Weigel

UX Lessons from running more than 1,200 A/B Tests

July 10, 2024

Onur Kocan

"Current projects mostly focus on collecting complaints rather than understanding the state."

Onur Kocan Ayhan Ensici

Understanding the Strategy for Civic Design in a Complex City: Istanbul

November 16, 2022

Megan Campos

"The viruses don't discriminate based on race, but our healthcare system does."

Megan Campos

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research

March 12, 2021

Jennifer Fraser

"Everything everyone knows is only a model. It’s important to get our models out there where they can be challenged."

Jennifer Fraser

What would Emmy Noether Do? Math, Models and Mulling in UX Research

March 29, 2023

Sofia Quintero

"You’re constantly training people and optimizing protocols even after successful implementation."

Sofia Quintero

Beyond Tools: The Messy Business of Implementing Research Repositories

March 10, 2022

Jemma Ahmed

"Difficult people need to sit and wallow in that difficult, messy middle with those difficult questions."

Jemma Ahmed

Theme 2 Intro

March 26, 2024

Jennifer Kanyamibwa

"Transparency is building respect for what your teammates do."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018