Rosenverse
The Five Dysfunctions of Democratized Research at Scale

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Five Dysfunctions of Democratized Research at Scale

Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
The Five Dysfunctions of Democratized Research at Scale
Speakers: Leisa Reichelt
Link:

Summary

As more organizations embrace research we move on to the second generation question – how do we scale this user centered behavior to support demand? There are fairly systemic issues that can undermine our best intentions. At best, it can render our research wasteful and inefficient, and at worst it can introduce significant risks in the decision making that our teams make. This talk considers five of the most likely challenges you’ll rub up against – speed, silos, teams, numbers and failure to mature. We’ll then discuss what causes these and what you can do to mitigate risks for your organization.

Key Insights

  • Democratizing research is more than encouraging everyone to talk to customers; it requires activating existing team tools thoughtfully.

  • There are two distinct jobs in customer research: building empathy for diverse contexts and gathering evidence to validate decisions.

  • Speed pressure often leads teams to cut corners in participant recruitment and data analysis, risking biased and invalid research.

  • Silo dysfunction arises when teams focus narrowly on their feature without considering the broader user context, increasing false positives.

  • Weaponizing research happens when teams use data combatively in internal disputes rather than as a tool for collaboration and understanding.

  • Quantitative data is often privileged because numbers are easier to digest, but mixed methods that combine qualitative insights yield richer results.

  • Early-stage usability testing with just one user can be beneficial to get started, but should not be the permanent approach for mature teams.

  • Risk management framing helps match research effort to the potential impact of decisions, optimizing resource use.

  • Involving product managers, designers, and engineers together in quality conversations enhances shared understanding and decision making.

  • Focusing on end-to-end user journeys rather than isolated features helps teams avoid narrow perspectives and create better product experiences.

Notable Quotes

"More people being closer to customers is very likely to help us achieve better products and services."

"Speed matters, but saving time in recruitment and analysis can lead to invalid and biased research."

"A developer pretending to be a product manager is not reliable participant data."

"People can make up an opinion about anything if asked, which leads to the query effect."

"False positives in research give teams misleading evidence that their solutions are working."

"Designers are not trusted unless they bring data to the table."

"Research should reduce the risk of investing in the wrong place or in the wrong way."

"Testing one user is 100 percent better than testing none, but it’s not a strategy forever."

"Qualitative research gives us the richer, more nuanced and complex conversations."

"Product managers ultimately make the call about research investments and prioritization."

Ask the Rosenbot
Jemma Ahmed
Bridge Building across Research Disciplines
2021 • Advancing Research Community
Paz Perez
Context Architecture for AI systems
2026 • Rosenfeld Community
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • DesignOps Summit 2025
Gold
Steve Sanderson
Discussion
2015 • Enterprise UX 2015
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Ricardo Martins
Unlocking the power of advanced quantitative methods
2025 • Advancing Research 2025
Gold
Dave Hora
Research in the Face of Complexity: New Sensibility for New Situations
2025 • Rosenfeld Community
Sofía Delsordo
Public Policy for Jalisco's Designers to Make Design Matter
2021 • Civic Design 2021
Gold
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Charles Lee
Building a New Home for the Atlassian Design System
2020 • Enterprise Community
Julie Norvaisas
Back to basics, or start from scratch?
2025 • Advancing Research 2025
Gold
Uday Gajendar
From AI to Zeitgeist: Theory as the design antidote to AI hype
2025 • Rosenfeld Community
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Kate Towsey
Ask Me Anything (AMA) with Kate Towsey
2025 • Rosenfeld Community
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold

More Videos

Meredith Black

"The biggest challenge is how to facilitate casual conversations that aren’t work process focused in a virtual world."

Meredith Black Elyse Hornbacher

Building Community and Common Trends to Look for in 2021

December 17, 2020

Tricia Wang

"Designers are the most insecure function in many companies because their role—to represent people's needs—is both critical and ambiguous."

Tricia Wang

The most popular design thinking strategy is BS

January 27, 2022

Michael Land

"Hiring specs for federal designers don’t exist as we expect—jobs are often classified as public affairs or other unrelated titles."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Bassel Deeb

"People often fill gaps in communication with their own anxieties, so clear communication is key."

Bassel Deeb Will Osborn

Do More With Less: Equip and Lead Design Orgs Through Adversity

October 2, 2023

Tanya Snook

"We do a lot of unstuck meetings—where anyone stuck can bring the problem and get brain help without judgment."

Tanya Snook

Designing the team experience: Building culture through onboarding

November 4, 2021

Allan Lowson

"A fully functioning prototype tells a much more complete and fluid story than a bunch of stitched screens."

Allan Lowson

Rehashing the Double Diamond: Collaborating across functions with AI-assisted prototyping

June 9, 2026

James Chudley

"Information architecture and digital housekeeping are lost arts that need revival to help minimize unnecessary digital clutter."

James Chudley

Decarbonising User Journeys: How minimising enables us to do more with less

February 19, 2025

Scott Jensen

"I didn’t invest enough in slow and steady relationship building early on, and that led to major shifts."

Scott Jensen Sarah Delaney Carmen Liu

Short Take #2: UX/Product Lessons from Your Industry Peers

December 6, 2022

Brennan Hartich

"Instead of adding more tools, we focused on removing unnecessary ones to reduce overhead."

Brennan Hartich

Communicating and Establishing DesignOps as a New Function

November 7, 2018