Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework

Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • Ethics should be embedded as a core value both in research operations and project prioritization.

  • Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Sharon Banh
Reimagining research: What does the field need to grow? [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
Mansi Gupta
Drawing from Feminist Practice to Make Inclusive Design Operational
2022 • DesignOps Summit 2022
Gold
Chris Hodowanec
Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner
2022 • Civic Design 2022
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Nathan Shedroff
Double Your Mileage: Use Your Research Strategically
2020 • Advancing Research 2020
Gold
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community
Paul Bakaus
Killing the handoff: Iterating design live in the browser on real production code
2026 • Designing with AI 2026
Conference
Meghan Bausone
Systems Thinking and Design Innovation: Working with Leverage Points in Rural Maternal Health Systems
2026 • Rosenfeld Community

More Videos

Bria Alexander

"Every talk you hear today couldn’t get more personal to our community."

Bria Alexander

Theme Two Intro

October 3, 2023

Ariba Jahan

"Survival can feel like a roller coaster with big energy spikes and drops, often leaving us completely depleted."

Ariba Jahan

Team Resiliency Through a Pandemic

January 8, 2024

Cornelius Rachieru

"Focusing exclusively on design systems, sprints, and agile commoditizes design and reduces it to cookie-cutter processes."

Cornelius Rachieru

Handling Complexity: Framing a Scale of Design

June 9, 2021

Megan Clegg

"Making accessibility a shared activity turns it into a team effort, involving co-workers, stakeholders, and customers."

Megan Clegg Michael Haggerty-Villa Alexis Morin

Space for Everyone: Reframing Accessibility Through a Wider Lens

June 10, 2021

Saara Kamppari-Miller

"Map tours are my favorite thing—taking a new hire on a guided walk of the entire community."

Saara Kamppari-Miller

Cartography for Design Communities

September 10, 2025

Kara Kane

"Legislation like the US executive order on federal customer experience has helped us rebuild trust in government."

Kara Kane

Theme One Intro

November 16, 2022

Natalia Radywyl

"Design for the government was something you do to outsource web development, not for serious problems."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Nancy Douyon

"We all want to design for scale, but empathy alone is sometimes a shortcoming when thinking about scale."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Peter Van Dijck

"When GPT came out, my kids immediately adopted it at school and couldn’t pry it from their dead hands."

Peter Van Dijck

Building the Rosenbot

June 4, 2024