Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Dark Side of Democratization

Friday, October 13, 2023 • Advancing Research Community
Share the love for this talk
Dark Side of Democratization
Speakers: Ari Zelmanow
Link:

Summary

The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.

Key Insights

  • The term 'democratization' in research is often misleading and functions as propaganda framing critics negatively.

  • Research involves three phases: impartial evidence collection, partial insight generation, and case presentation with a point of view.

  • Good enough research is often not actually good enough; the risks of poor-quality research can undermine business decisions.

  • The Dunning-Kruger effect leads untrained non-researchers to overestimate their research competence.

  • Democratization without guardrails creates a 'wild west' in organizations where research quality and ethics suffer.

  • Researchers have specialized training akin to physicians or detectives, which cannot be casually transferred.

  • Well-designed democratization programs require explicit governance, training, coaching, and clear boundaries on what non-experts can do.

  • Making insights ubiquitous and accessible across the business is more beneficial than broadly democratizing research tasks.

  • Research value lies more in developing informed points of view and strategic decision support than in merely delivering data or reports.

  • The research profession struggles with balancing rigor and protecting the domain without resorting to excessive gatekeeping.

Notable Quotes

"The very word democratization in research is misleading, almost akin to propaganda."

"Good enough research? Sometimes good enough isn’t good enough."

"Who would you rather have conduct heart surgery? A part-time or full-time surgeon? That’s specialization."

"The risk of using bad data is worse than using no data."

"There are no guardrails in democratization, and that is dangerous."

"Researchers are like detectives. We turn data into stories, stories into strategy, strategy into outcome."

"Overconfidence is a problem caused by the Dunning-Kruger effect in research democratization."

"Making insights ubiquitous is different from allowing anyone to do research."

"Businesses don’t democratize functions like finance or engineering; why research?"

"Our value as researchers is the diversity of thought and experience to develop a point of view."

Ask the Rosenbot
Scott Stephens
The Next Generation in DesignOps Toolsets
2022 • DesignOps Community
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Billy Carlson
Tips to Utilize Wireframes to Tell an Effective Product Story
2023 • Enterprise UX 2023
Gold
Doug Powell
Closing Keynote: Design at Scale
2018 • DesignOps Summit 2018
Gold
Toby Haug
Discussion
2017 • Enterprise Experience 2017
Gold
Kristin Skinner
Theme 1 Intro
2021 • DesignOps Summit 2021
Gold
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps Summit 2024
Gold
Andy Barraclough
From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme
2024 • DesignOps Summit 2024
Gold
Sofía Delsordo
Public Policy for Jalisco's Designers to Make Design Matter
2021 • Civic Design 2021
Gold
Corey Nelson
Layoffs
2022 • Advancing Research Community
Rachael Dietkus, LCSW
Everything You Need to Know about the Civic Design 2022 Call for Presentations
2022 • Civic Design Community
Soma Ghosh
What emerging methods are advancing UX research [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold

More Videos

Bria Alexander

"The good vibes you experience are a reflection of the positive collaborative spirit we worked hard to create for you."

Bria Alexander

Theme Two Intro

October 3, 2023

Ariba Jahan

"People were taking vacation days just to homeschool or take care of a loved one."

Ariba Jahan

Team Resiliency Through a Pandemic

January 8, 2024

Cornelius Rachieru

"We tend to put the end user first, but we must also ask who we might be doing harm to beyond primary users."

Cornelius Rachieru

Handling Complexity: Framing a Scale of Design

June 9, 2021

Megan Clegg

"Automated tests only get you so far; manual QA by people aware of accessibility needs is essential."

Megan Clegg Michael Haggerty-Villa Alexis Morin

Space for Everyone: Reframing Accessibility Through a Wider Lens

June 10, 2021

Saara Kamppari-Miller

"Map tours are my favorite thing—taking a new hire on a guided walk of the entire community."

Saara Kamppari-Miller

Cartography for Design Communities

September 10, 2025

Kara Kane

"Design ideas come back around again and again, waiting for leadership or new contexts to take root."

Kara Kane

Theme One Intro

November 16, 2022

Natalia Radywyl

"Designers need to switch hats when working with people who aren’t trained designers — mentoring is essential."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Nancy Douyon

"We Westerners are designing for ourselves without realizing it, feeding back into a loop of luxury products."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Peter Van Dijck

"This AI stuff is a new design material, just like the internet or mobile was before."

Peter Van Dijck

Building the Rosenbot

June 4, 2024