Rosenverse
The Five Dysfunctions of Democratized Research at Scale

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Five Dysfunctions of Democratized Research at Scale

Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
The Five Dysfunctions of Democratized Research at Scale
Speakers: Leisa Reichelt
Link:

Summary

As more organizations embrace research we move on to the second generation question – how do we scale this user centered behavior to support demand? There are fairly systemic issues that can undermine our best intentions. At best, it can render our research wasteful and inefficient, and at worst it can introduce significant risks in the decision making that our teams make. This talk considers five of the most likely challenges you’ll rub up against – speed, silos, teams, numbers and failure to mature. We’ll then discuss what causes these and what you can do to mitigate risks for your organization.

Key Insights

  • •

    Democratizing research is more than encouraging everyone to talk to customers; it requires activating existing team tools thoughtfully.

  • •

    There are two distinct jobs in customer research: building empathy for diverse contexts and gathering evidence to validate decisions.

  • •

    Speed pressure often leads teams to cut corners in participant recruitment and data analysis, risking biased and invalid research.

  • •

    Silo dysfunction arises when teams focus narrowly on their feature without considering the broader user context, increasing false positives.

  • •

    Weaponizing research happens when teams use data combatively in internal disputes rather than as a tool for collaboration and understanding.

  • •

    Quantitative data is often privileged because numbers are easier to digest, but mixed methods that combine qualitative insights yield richer results.

  • •

    Early-stage usability testing with just one user can be beneficial to get started, but should not be the permanent approach for mature teams.

  • •

    Risk management framing helps match research effort to the potential impact of decisions, optimizing resource use.

  • •

    Involving product managers, designers, and engineers together in quality conversations enhances shared understanding and decision making.

  • •

    Focusing on end-to-end user journeys rather than isolated features helps teams avoid narrow perspectives and create better product experiences.

Notable Quotes

"More people being closer to customers is very likely to help us achieve better products and services."

"Speed matters, but saving time in recruitment and analysis can lead to invalid and biased research."

"A developer pretending to be a product manager is not reliable participant data."

"People can make up an opinion about anything if asked, which leads to the query effect."

"False positives in research give teams misleading evidence that their solutions are working."

"Designers are not trusted unless they bring data to the table."

"Research should reduce the risk of investing in the wrong place or in the wrong way."

"Testing one user is 100 percent better than testing none, but it’s not a strategy forever."

"Qualitative research gives us the richer, more nuanced and complex conversations."

"Product managers ultimately make the call about research investments and prioritization."

Ask the Rosenbot
Peter Van Dijck
Designing AI-first products on top of a rapidly evolving technology
2025 • Designing with AI 2025
Gold
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Alnie Figueroa
The Future of Design Operations: Transforming Our Craft
2025 • DesignOps Summit 2025
Gold
John Cutler
Prioritization for designers and product managers (1st of 3 seminars)
2024 • Rosenfeld Community
Raven Veal
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
2021 • Advancing Research 2021
Gold
Nalini Kotamraju
Research After UX
2024 • Advancing Research 2024
Gold
Catt Small
Your Future is Nebulous—and Why That's Good
2026 • Shift UX 2026
Conference
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Maria Giudice
Becoming a Changemaker by Leading with Design
2023 • Advancing Research 2023
Gold
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
John Cutler
The Alignment Trap
2023 • Design in Product 2023
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Giff Constable
Financial fluency for product leaders: AMA with Giff Constable
2024 • Rosenfeld Community
You’ve got Gold! A Rosenverse demo with Lou Rosenfeld
2026 • Rosenfeld Community

More Videos

Christopher Noessel

"My Roomba vacuums while I’m at work. It does its work out of my attention."

Christopher Noessel

AI of the now: Designing for Agents

July 31, 2024

Caroline Vize

"UX research is a journey, not just a switch you flick on; many challenges you face have been experienced by others in the community."

Caroline Vize

The State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022

March 9, 2022

Kate Koch

"Telepathy as mind reading means proactively building a talent pipeline and improving recruitment processes."

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Jessamyn Edwards

"If someone asks you for a cup of coffee, here’s the cup of coffee. You did it. But always have proposals on the side for more."

Jessamyn Edwards

Surviving Your UX Career in Enterprise Design

December 2, 2021

Jemma Ahmed

"Democratization is not research anarchy where anybody can talk to any customer for any reason with no oversight."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Sharbani Dhar

"SAFE is essentially a software development methodology, and fitting experience design into it has been a constant trial and error."

Sharbani Dhar

Breathing Room for Delight

January 8, 2024

Ned Dwyer

"Measuring impact means linking research insights back to decisions and how they affect roadmaps and priorities."

Ned Dwyer Emily Stewart James Wallis

The Intersection of Design and ResearchOps

September 24, 2024

Bud Caddell

"I want to know about bruises, lessons learned, not just best practices."

Bud Caddell

Theme 2 Intro

September 30, 2021

Michael Weir

"Using a mixture of behavioral science, analytics, and experiments helps prioritize changes that truly move KPIs."

Michael Weir

Mixed Methods and Behavioural Science

May 26, 2023

Latest Books All books