Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • Ethics should be embedded as a core value both in research operations and project prioritization.

  • Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
Bria Alexander
Charting the future of DesignOps: A community workshop
2024 • DesignOps Community
Kyria Stephens
Power to Heal: Civic Design in the Aftermath of Tragedy
2022 • Civic Design 2022
Gold
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Ed Mullen
Designing the Unseen: Enabling Institutions to Build Public Trust
2022 • Civic Design 2022
Gold
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
George Abraham
Design Systems To-Go: Introducing a Starter Design System, and Indigo.Design Overview (Part 1)
2021 • DesignOps Summit 2021
Gold
Matt Stone
Scaling Empathy, A Case Study in Change Management
2021 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Bria Alexander
Day 3 Welcome
2024 • DesignOps Summit 2024
Gold
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Liz Ebengo
The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward
2024 • Advancing Service Design 2024
Gold
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold

More Videos

Sara Logel

"Stakeholders are users too; the product we’re sharing is the research and learnings for their decision-making."

Sara Logel

Your Colleagues are Your Users Too

March 29, 2023

Dan Willis

"Enterprise problems are often engineering problems as much as design problems."

Dan Willis

Enterprise Storytelling Sessions

May 13, 2015

Aiyana Bodi

"UX designers have the power to design interactions that encourage environmentally friendly behaviors."

Aiyana Bodi James Christie Marc O'Brien Louis Rosenfeld

Three Key Climate Initiatives and How You Can Help

September 11, 2024

Liam Thurston

"Mastery is achievable, whether you have 10,000 hours or not—it’s about building that portfolio and case studies."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022

Chris Moses

"We built an app to let reviewers asynchronously capture design audit findings, significantly reducing scheduling friction."

Chris Moses

Stretching the Definition of DesignOps with Product Development

November 7, 2018

Janaki Kumar

"When you’re passionate about a topic, you hear the song loudly in your head; the listener just hears clapping."

Janaki Kumar

Innovate with Purpose

June 14, 2018

Smitha Papolu

"Code-switching between your native tongue and someone else’s helps foster better connection."

Smitha Papolu Nova Wehman-Brown Melissa Schmidt Adam Menter

Theme 3 Discussion

January 8, 2024

Noah Bond

"Many stakeholders blur fact and opinion, making it harder to influence with sound research insights."

Noah Bond

Redefining truth and inclusivity: Navigating data ownership and ethical research in the age of disinformation

March 11, 2025

Tanya Snook

"There wasn't much attention paid to onboarding team members—not the clients or users, but the actual team."

Tanya Snook

Designing the team experience: Building culture through onboarding

November 4, 2021