Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework

Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • Ethics should be embedded as a core value both in research operations and project prioritization.

  • Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Maria Giudice
Empowering change: Reigniting purpose, passion and impact in research
2025 • Advancing Research 2025
Gold
Dane DeSutter
What co-speech gestures reveal about users’ thinking during interviews
2023 • Rosenfeld Community
Aleksandra Korczynska
Survey Tools
2026 • Advancing Research 2026
Gold
Daniel J. Rosenberg
Digital Medicine Design
2019 • Enterprise Community
Etienne Fang
Power of Insights: Why sharing is better than silos with Uber’s Insights Platform
2019 • Advancing Research Community
Uday Gajendar
The Rise of Meta-Design: A Starter Playbook
2022 • Enterprise Community
Anil Dash
Designing with power in the age of AI
2026 • Designing with AI 2026
Conference
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Surya Vanka
Unleashing Swarm Creativity to Solve Enterprise Challenges
2021 • Design at Scale 2021
Gold
Michelle Morrison
Culture Design
2020 • DesignOps Community
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Allan Lowson
Rehashing the Double Diamond: Collaborating across functions with AI-assisted prototyping
2026 • Designing with AI 2026
Conference
Kate Stern
Scaling Learning for the Future
2022 • DesignOps Summit 2022
Gold
Hugh Dubberly
Problems with Problems: Reconsidering the Frame of Designing as Problem-Solving
2019 • Enterprise Community

More Videos

Maria Giudice

"Design is not a noun. Design is an active verb."

Maria Giudice

Remaking the Making Company: Moving from Product to Experience

June 9, 2016

Christian Crumlish

"Product managers are responsible for value – making sure something valuable is being created that meets real needs."

Christian Crumlish

AMA with Christian Crumlish, author of Product Management for UX People

March 24, 2022

Rima Campbell

"UX assets are our business assets."

Rima Campbell Amrit S Bhachu

Increase Productivity and Drive Business Impact

September 24, 2024

Sam Proulx

"Accessibility is not only important to preserve rights but leads directly to innovation."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

June 10, 2022

Victor Udoewa

"Land acknowledgments don’t actually change the allocation of power or resources; they work at the mythological level."

Victor Udoewa

Radical Participatory Design: Decolonizing Participatory Design Processes

December 10, 2021

Jon Fukuda

"Getting people who don’t communicate well to at least work together on a single thing is the first step to innovating together."

Jon Fukuda Amy Evans Ignacio Martinez Joe Meersman

The Big Question about Innovation: A Panel Discussion

September 25, 2024

Rachael Dietkus, LCSW

"There is a synergy between design and social work values that gives trauma-informed design its meaning and purpose."

Rachael Dietkus, LCSW

Trauma-Responsive Design: Reimagining the Future of Design Now

December 10, 2021

Kyria Stephens

"The shooter used census data to target the location to inflict the most damage on Black people."

Kyria Stephens Marlon Kerner

Power to Heal: Civic Design in the Aftermath of Tragedy

November 17, 2022

Niko Laitinen

"People were pushed but had no idea what was expected from them — adaptability was lacking."

Niko Laitinen

Adaptable Org Design for Resilient Times

June 10, 2021