Rosenverse
Dark Side of Democratization

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Dark Side of Democratization

Friday, October 13, 2023 • Advancing Research Community
Share the love for this talk
Dark Side of Democratization
Speakers: Ari Zelmanow
Link:

Summary

The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.

Key Insights

  • The term 'democratization' in research is often misleading and functions as propaganda framing critics negatively.

  • Research involves three phases: impartial evidence collection, partial insight generation, and case presentation with a point of view.

  • Good enough research is often not actually good enough; the risks of poor-quality research can undermine business decisions.

  • The Dunning-Kruger effect leads untrained non-researchers to overestimate their research competence.

  • Democratization without guardrails creates a 'wild west' in organizations where research quality and ethics suffer.

  • Researchers have specialized training akin to physicians or detectives, which cannot be casually transferred.

  • Well-designed democratization programs require explicit governance, training, coaching, and clear boundaries on what non-experts can do.

  • Making insights ubiquitous and accessible across the business is more beneficial than broadly democratizing research tasks.

  • Research value lies more in developing informed points of view and strategic decision support than in merely delivering data or reports.

  • The research profession struggles with balancing rigor and protecting the domain without resorting to excessive gatekeeping.

Notable Quotes

"The very word democratization in research is misleading, almost akin to propaganda."

"Good enough research? Sometimes good enough isn’t good enough."

"Who would you rather have conduct heart surgery? A part-time or full-time surgeon? That’s specialization."

"The risk of using bad data is worse than using no data."

"There are no guardrails in democratization, and that is dangerous."

"Researchers are like detectives. We turn data into stories, stories into strategy, strategy into outcome."

"Overconfidence is a problem caused by the Dunning-Kruger effect in research democratization."

"Making insights ubiquitous is different from allowing anyone to do research."

"Businesses don’t democratize functions like finance or engineering; why research?"

"Our value as researchers is the diversity of thought and experience to develop a point of view."

Ask the Rosenbot
Theresa Neil
Designing for Wellness: Specializing in Healthcare
2024 • Rosenfeld Community
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Stephanie Wade
Building and Sustaining Design in Government
2021 • Civic Design 2021
Gold
Etienne Fang
Power of Insights: Why sharing is better than silos with Uber’s Insights Platform
2019 • Advancing Research Community
Christopher Taylor Edwards
Design as a Team Practice, A Practical Guide to Cross-functional Collaboration
2021 • DesignOps Summit 2021
Gold
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Charles Lee
Building a New Home for the Atlassian Design System
2020 • Enterprise Community
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Rittika Basu
Age and Interfaces: Equipping Older Adults with Technological Tools
2023 • Advancing Research Community
Dane DeSutter
Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries
2024 • QuantQual Interest Group
Rob Mitzel
The Tale of Two Companies: Building a Successful UX Practice in a Century-Old Enterprise
2024 • Enterprise Experience 2020
Gold
Jen van der Meer
Service design performs value
2025 • Advancing Service Design 2025
Gold
Gabrielle Verderber
Documentation Your Team Will Actually Use
2023 • DesignOps Summit 2023
Gold
Steve Portigal
War Stories LIVE! Steve Portigal
2020 • Advancing Research 2020
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Joshua Graves
We Need To Talk: Managing Ludicrous Requests at Work (Part 3 of 3)
2025 • Rosenfeld Community

More Videos

Daniel Gloyd

"Rather than problem solving, it’s conversation that should drive design."

Daniel Gloyd

Designing Warmth

February 26, 2025

David Sternberg

"With QFI, we go upstream: simulate, model, predict user behavior before shipping, not just react after."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025

Karen McGrane

"Trying to map all possible connotations and context in language is mind-bogglingly computationally expensive."

Karen McGrane Jeff Eaton

AI for Information Architects: Are the robots coming for our jobs?

November 21, 2024

John Cutler

"Trying to force one preeminent model for the company is a recipe for disaster—embrace models and understand why people are using them."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Erin Hoffman-John

"Ecosystems have reinforcing loops that can be out of control, like algae in a fish tank, and balancing loops that maintain equilibrium."

Erin Hoffman-John

This Game is Never Done: Design Leadership Techniques from the Video Game World

November 6, 2017

Matt Duignan

"HITS is not a replacement for researchers but an augmentation to scale their expertise across the organization."

Matt Duignan

HITS, Microsoft's internal human insight system: From research library to living body of knowledge

July 16, 2019

Peter Merholz

"Organizing design teams by user journey rather than by product better supports a coherent end-to-end experience."

Peter Merholz

Design at Scale is People!

June 11, 2021

Davis Neable

"The work we do is fundamentally human, and humans are messy—sometimes things work, sometimes they don’t."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Catt Small

"Move thoughtfully and purposefully is better than move fast and break things, especially in large companies with millions of users."

Catt Small

Craft a Vision that Actually Gets Shipped

April 30, 2026