Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • Ethics should be embedded as a core value both in research operations and project prioritization.

  • Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
Prayag Narula
HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
2023 • Advancing Research 2023
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Ovetta Sampson
Managing the Human Engagement Risks of AI
2025 • Designing with AI 2025
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Ebru Namaldi
Designing the Designer’s Journey: Scaling Teams, Culture, and Growth Through DesignOps
2025 • DesignOps Summit 2025
Gold
Jon Fukuda
Design Planning and Management Support
2023 • DesignOps Summit 2023
Gold
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Jen van der Meer
Service design performs value
2025 • Advancing Service Design 2025
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Jessica Norris
ADHD: A DesignOps Superpower
2022 • DesignOps Summit 2022
Gold
Jane Reid
Self-care in User Research
2020 • Advancing Research Community
Daniel Korczynski
Why AI Is Bad at Research (and how to make it actually useful)
2026 • Advancing Research 2026
Conference
Dane DeSutter
What co-speech gestures reveal about users’ thinking during interviews
2023 • Rosenfeld Community
Ashley Sewall
Exit Interview #5: Designing My Life After Tech
2026 • Rosenfeld Community
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold

More Videos

Aaron Stienstra

"Reflecting on our power as implementers of policy, we must reciprocate by giving back information and value to those we engage."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021

John Donmoyer

"I have somehow managed to not open Figma for the last six months, which I couldn’t have believed a year ago."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Sheryl Cababa

"Pilots and prototyping create evidence to inform decisions, making change more achievable and less risky."

Sheryl Cababa Alexis Oh

Thinking in systems to address climate with Sheryl Cababa

June 12, 2024

Ariel Kennan

"This was a transformational day where everyone got to join together."

Ariel Kennan

Building a Design Culture

June 9, 2017

Ignacio Martinez

"Our evaluation tool is a Google Sheet so we can quickly make adjustments without being bogged down by unnecessary features."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Dave Hora

"Visual diagnosis builds credibility and trust before you ever do user interviews or tests."

Dave Hora

Advice for Establishing Research

December 8, 2022

Dr. Jamika D. Burge

"We need to ask participants how much time they have and want to contribute to avoid extractive research."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices

September 15, 2022

James Rampton

"Rivian told Volkswagen, You tell us how to make a software-based vehicle; we’ll build the frame around the computer system and sensors."

James Rampton

The Basics of Automotive UX & Why Phones Are a Part of That Future

July 25, 2024

Kristin Wisnewski

"We’re the voice of the employee—we’re arbiters of truth, defenders of experience, and sometimes validators against manipulation."

Kristin Wisnewski

Measuring What Matters

October 23, 2019