Rosenverse
The Five Dysfunctions of Democratized Research at Scale

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Five Dysfunctions of Democratized Research at Scale

Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
The Five Dysfunctions of Democratized Research at Scale
Speakers: Leisa Reichelt
Link:

Summary

As more organizations embrace research we move on to the second generation question – how do we scale this user centered behavior to support demand? There are fairly systemic issues that can undermine our best intentions. At best, it can render our research wasteful and inefficient, and at worst it can introduce significant risks in the decision making that our teams make. This talk considers five of the most likely challenges you’ll rub up against – speed, silos, teams, numbers and failure to mature. We’ll then discuss what causes these and what you can do to mitigate risks for your organization.

Key Insights

  • •

    Democratizing research is more than encouraging everyone to talk to customers; it requires activating existing team tools thoughtfully.

  • •

    There are two distinct jobs in customer research: building empathy for diverse contexts and gathering evidence to validate decisions.

  • •

    Speed pressure often leads teams to cut corners in participant recruitment and data analysis, risking biased and invalid research.

  • •

    Silo dysfunction arises when teams focus narrowly on their feature without considering the broader user context, increasing false positives.

  • •

    Weaponizing research happens when teams use data combatively in internal disputes rather than as a tool for collaboration and understanding.

  • •

    Quantitative data is often privileged because numbers are easier to digest, but mixed methods that combine qualitative insights yield richer results.

  • •

    Early-stage usability testing with just one user can be beneficial to get started, but should not be the permanent approach for mature teams.

  • •

    Risk management framing helps match research effort to the potential impact of decisions, optimizing resource use.

  • •

    Involving product managers, designers, and engineers together in quality conversations enhances shared understanding and decision making.

  • •

    Focusing on end-to-end user journeys rather than isolated features helps teams avoid narrow perspectives and create better product experiences.

Notable Quotes

"More people being closer to customers is very likely to help us achieve better products and services."

"Speed matters, but saving time in recruitment and analysis can lead to invalid and biased research."

"A developer pretending to be a product manager is not reliable participant data."

"People can make up an opinion about anything if asked, which leads to the query effect."

"False positives in research give teams misleading evidence that their solutions are working."

"Designers are not trusted unless they bring data to the table."

"Research should reduce the risk of investing in the wrong place or in the wrong way."

"Testing one user is 100 percent better than testing none, but it’s not a strategy forever."

"Qualitative research gives us the richer, more nuanced and complex conversations."

"Product managers ultimately make the call about research investments and prioritization."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Vanessa Varin
Tools are moments. Capabilities compound.
2026 • Rosenfeld Community
Samuel Martin
Co-Design vs Faux-Design: Navigating the Complexities of Sharing Power in Co-Design
2026 • Rosenfeld Community
Erika Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Robin Beers
How to create actionable insight in the face of politics and silos [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Marc Fonteijn
First Insights from the 2025 Service Design Salary(+) Report
2024 • Advancing Service Design 2024
Gold
Kara Kane
Theme One Intro
2022 • Civic Design 2022
Gold
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Caroline Jarrett
Have fun with statistics?
2024 • Rosenfeld Community
Dan Brown
Live Sensemaking: How might we better metabolize knowledge?
2026 • Shift UX 2026
Conference
Taiye Akin-Akinyosoye
Amplifying voices and enhancing user research through group interviews
2025 • Advancing Research 2025
Gold
Sarit Geertjes
People, not Petri Dishes: Stories from a Research Recruiter
2019 • DesignOps Community
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Julia Barham
What Hiring Managers Look for in Product Management Interviews
2026 • Rosenfeld Community
Dane DeSutter
What co-speech gestures reveal about users’ thinking during interviews
2023 • Rosenfeld Community

More Videos

Dr. Karl Jeffries

"If you said are you creative, I’m gonna say hell yeah."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"Investment is attention: If the business funds you, it means they believe in what you do."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Trust is built by showing you’re there to help make them succeed, not just push your agenda."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"Involving designers early in the process is crucial to avoid the 'fast-food' model where they feel like order takers."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"I am not throwing away your UX."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"Stakeholders start demanding better digital experiences at work because they expect the same quality they have at home."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"Most organizations don’t have one research tool, but a mix, so openness and integration are essential."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"Lawyers, though nervous, can become some of the most reasonable people you deal with if you explain risks clearly."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"Combining the what we see in data with the why we get from user research is where true insights live."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books