Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Dark Side of Democratization
Summary
The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.
Key Insights
-
•
The term 'democratization' in research is often misleading and functions as propaganda framing critics negatively.
-
•
Research involves three phases: impartial evidence collection, partial insight generation, and case presentation with a point of view.
-
•
Good enough research is often not actually good enough; the risks of poor-quality research can undermine business decisions.
-
•
The Dunning-Kruger effect leads untrained non-researchers to overestimate their research competence.
-
•
Democratization without guardrails creates a 'wild west' in organizations where research quality and ethics suffer.
-
•
Researchers have specialized training akin to physicians or detectives, which cannot be casually transferred.
-
•
Well-designed democratization programs require explicit governance, training, coaching, and clear boundaries on what non-experts can do.
-
•
Making insights ubiquitous and accessible across the business is more beneficial than broadly democratizing research tasks.
-
•
Research value lies more in developing informed points of view and strategic decision support than in merely delivering data or reports.
-
•
The research profession struggles with balancing rigor and protecting the domain without resorting to excessive gatekeeping.
Notable Quotes
"The very word democratization in research is misleading, almost akin to propaganda."
"Good enough research? Sometimes good enough isn’t good enough."
"Who would you rather have conduct heart surgery? A part-time or full-time surgeon? That’s specialization."
"The risk of using bad data is worse than using no data."
"There are no guardrails in democratization, and that is dangerous."
"Researchers are like detectives. We turn data into stories, stories into strategy, strategy into outcome."
"Overconfidence is a problem caused by the Dunning-Kruger effect in research democratization."
"Making insights ubiquitous is different from allowing anyone to do research."
"Businesses don’t democratize functions like finance or engineering; why research?"
"Our value as researchers is the diversity of thought and experience to develop a point of view."
Or choose a question:
More Videos
"Rather than problem solving, it’s conversation that should drive design."
Daniel GloydDesigning Warmth
February 26, 2025
"With QFI, we go upstream: simulate, model, predict user behavior before shipping, not just react after."
David SternbergUncovering the hidden forces shaping user behavior
July 17, 2025
"Trying to map all possible connotations and context in language is mind-bogglingly computationally expensive."
Karen McGrane Jeff EatonAI for Information Architects: Are the robots coming for our jobs?
November 21, 2024
"Trying to force one preeminent model for the company is a recipe for disaster—embrace models and understand why people are using them."
John CutlerOxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
December 3, 2024
"Ecosystems have reinforcing loops that can be out of control, like algae in a fish tank, and balancing loops that maintain equilibrium."
Erin Hoffman-JohnThis Game is Never Done: Design Leadership Techniques from the Video Game World
November 6, 2017
"HITS is not a replacement for researchers but an augmentation to scale their expertise across the organization."
Matt DuignanHITS, Microsoft's internal human insight system: From research library to living body of knowledge
July 16, 2019
"Organizing design teams by user journey rather than by product better supports a coherent end-to-end experience."
Peter MerholzDesign at Scale is People!
June 11, 2021
"The work we do is fundamentally human, and humans are messy—sometimes things work, sometimes they don’t."
Davis Neable Guy SegalHow to Drive a Design Project When you Don’t Have a Design Team
June 10, 2021
"Move thoughtfully and purposefully is better than move fast and break things, especially in large companies with millions of users."
Catt SmallCraft a Vision that Actually Gets Shipped
April 30, 2026