Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Dark Side of Democratization
Friday, October 13, 2023 • Advancing Research Community
Share the love for this talk
Dark Side of Democratization
Speakers: Ari Zelmanow
Link:

Summary

The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.

Key Insights

  • The term 'democratization' in research is often misleading and functions as propaganda framing critics negatively.

  • Research involves three phases: impartial evidence collection, partial insight generation, and case presentation with a point of view.

  • Good enough research is often not actually good enough; the risks of poor-quality research can undermine business decisions.

  • The Dunning-Kruger effect leads untrained non-researchers to overestimate their research competence.

  • Democratization without guardrails creates a 'wild west' in organizations where research quality and ethics suffer.

  • Researchers have specialized training akin to physicians or detectives, which cannot be casually transferred.

  • Well-designed democratization programs require explicit governance, training, coaching, and clear boundaries on what non-experts can do.

  • Making insights ubiquitous and accessible across the business is more beneficial than broadly democratizing research tasks.

  • Research value lies more in developing informed points of view and strategic decision support than in merely delivering data or reports.

  • The research profession struggles with balancing rigor and protecting the domain without resorting to excessive gatekeeping.

Notable Quotes

"The very word democratization in research is misleading, almost akin to propaganda."

"Good enough research? Sometimes good enough isn’t good enough."

"Who would you rather have conduct heart surgery? A part-time or full-time surgeon? That’s specialization."

"The risk of using bad data is worse than using no data."

"There are no guardrails in democratization, and that is dangerous."

"Researchers are like detectives. We turn data into stories, stories into strategy, strategy into outcome."

"Overconfidence is a problem caused by the Dunning-Kruger effect in research democratization."

"Making insights ubiquitous is different from allowing anyone to do research."

"Businesses don’t democratize functions like finance or engineering; why research?"

"Our value as researchers is the diversity of thought and experience to develop a point of view."

Ask the Rosenbot
John Maeda
About Design Organizations
2019 • DesignOps Community
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold
Deanna Washington
Scaling Success: Paving the Path from DesignOps to VP
2023 • DesignOps Summit 2023
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Andy Polaine
What is the role of service design in product-led organizations?
2024 • Advancing Service Design 2024
Gold
Laura Klein
Unique challenges of innovation in enterprises
2020 • Enterprise Community
Russell Blair
Killing the blank page
2024 • Designing with AI 2024
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Brigette Metzler
Scaling ResearchOps: Helping Researchers do Their Best Work
2020 • Advancing Research 2020
Gold
Dean Broadley
Not Black Enough to be White
2024 • DesignOps Summit 2020
Gold
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Fredrik Matheson
First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.
2016 • Enterprise UX 2016
Gold
Nathan Shedroff
Redefining Value: Bridging the Innovation Culture Divide
2015 • Enterprise UX 2015
Gold

More Videos

Sam Proulx

"Accessibility isn’t a checkbox you run automated tests for; you must involve people with disabilities to benchmark success."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Ignacio Martinez

"The career path shows when someone is ready for promotion, but additional training may be needed to support leadership transitions."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Sarah Kinkade

"Transformation is new ways of thinking and eventually doing; we won’t have all the answers at the start and that’s okay."

Sarah Kinkade Mariana Ortiz-Reyes

Design Management Models in the Face of Transformation

June 8, 2022

Daniel Gloyd

"We as humans value warmth information in others more than competence information."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Patrick Boehler

"The careful application of structured queries can reveal deeper insights than traditional research alone."

Patrick Boehler

Fishing for Real Needs: Reimagining Journalism Needs with AI

June 10, 2025

Andy Barraclough

"Anyone can do a basic AI summary with zero control, but we offer robust, evidence-backed, scalable chat analysis."

Andy Barraclough Betsy Nelson

From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme

September 23, 2024

Alexandra Schmidt

"How do we as designers connect more deeply with the policy world? That’s still a developing thing."

Alexandra Schmidt

Why Ethics Can't Save Tech

November 18, 2022

Louis Rosenfeld

"Strategic friction is about where you apply friction deliberately to create insight and transformation."

Louis Rosenfeld

Discussion: What Operations can teach DesignOps

November 6, 2017

Mitchell Bernstein

"Design systems are the language of implementation; they allow us to communicate ideas in a common format and process."

Mitchell Bernstein

Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape

September 29, 2021