Right horses for the right courses – how and when to democratize research
This video is featured in the UX Watch Party playlist.
Summary
In this talk, I’ll share a practical framework for when to democratize and when to centralize research. You’ll learn how to weigh risk, reversibility, and audience impact; how to put guardrails around democratized research; and how AI can enable broader participation without chaos. You’ll leave with a decision matrix and a “democratization charter” you can adapt to your org, so the right people are on the right horses for the right courses.
Key Insights
-
•
Democratization of research exists on a spectrum and must be customized to each organization's context, risk tolerance, and regulatory environment.
-
•
Not all research tasks should be democratized; high-risk or unclear problems require specialist researcher involvement.
-
•
AI tools are enabling broader roles for PMs and designers, allowing faster prototyping and product documentation, blurring specialist boundaries.
-
•
Effective democratization requires elegant guardrails to protect participant safety, data privacy, and research quality.
-
•
Democratization can massively increase organizational research capacity, as Flight Center’s example shows, tripling volume while maintaining quality.
-
•
Training and certification are critical to enable non-researchers to run low-risk studies effectively and ethically.
-
•
Bias awareness and anti-bias training are essential components of democratization to maintain the integrity of insights.
-
•
A democratization charter outlining who can conduct research, with which audiences and methods, helps set clear expectations and governance.
-
•
Research maturity assessment helps determine an organization's readiness for democratization and identifies needed upskilling.
-
•
Research quality control currently relies on script review and coaching but is evolving toward AI-supported automatic quality feedback.
Notable Quotes
"Democratization is here to stay, and it’s a positive force for good in product development."
"The democratization spectrum ranges from everyone accessing feedback to a free-for-all, but I don’t advocate for a free-for-all."
"We need elegant guardrails to keep the business safe, keep participants safe, and make democratization ethical."
"Flight Center went from 10 researchers running research to over 130 people trained to safely do interviews."
"When done right, democratization multiplies the impact of research rather than diluting it."
"The goal is to lower the floor for who can access research while raising the ceiling of what’s possible."
"It should be as easy to run research as brushing your teeth."
"AI will soon enable us to automatically flag leading questions and coach researchers for quality."
"Not every problem needs research; sometimes it’s fine to ship quickly and learn after."
"Training non-researchers in bias awareness and methodology is essential to prevent poor data and insights."
Or choose a question:
More Videos
"We use frameworks in Mural that come with built-in instructions enabling asynchronous facilitation."
Erika FlowersIntroduction to MURAL for UX
June 11, 2021
"Culture is the lens through which we experience our lives and products today."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"Find somebody else with a really big problem and go solve it for them using your tools. Don’t even talk about what design is."
Robert SchwartzWe're Here for the Humans
June 9, 2017
"You might find that spending the most time getting people interested in collaboration is where the work really happens."
Marieke McCloskeyUser Science: Product Analytics & User Research
March 11, 2021
"Everything can be designed – ourselves, relationships, processes, policies, systems."
Bria Alexander Ariel Kennan Charlotte Lee Sarah Brooks Emily Lessard Gordon Ross Joanne DongReflect and Chart Forward
December 10, 2021
"Reducing buttons from six to two and including peripheral information facilitated buying and editing while increasing conversion by 10%."
Shan ShenTranslating UX Terms into Business Contexts
November 29, 2023
"The anxiety and emotional dysregulation create a perfect storm that makes change feel overwhelming for neurodiverse people."
Pippa LomasPaving the Path for Neurodiversity in Design
October 4, 2023
"The storytelling is what ultimately supports actual change more than just data."
Jemma Ahmed Chris GeisonBridge Building across Research Disciplines
August 26, 2021
"Far too often security fails because we forget people are involved."
Jeff SussnaWhat DesignOps Can Learn From DevOps
November 6, 2017
