Right horses for the right courses – how and when to democratize research
This video is featured in the UX Watch Party playlist.
Summary
In this talk, I’ll share a practical framework for when to democratize and when to centralize research. You’ll learn how to weigh risk, reversibility, and audience impact; how to put guardrails around democratized research; and how AI can enable broader participation without chaos. You’ll leave with a decision matrix and a “democratization charter” you can adapt to your org, so the right people are on the right horses for the right courses.
Key Insights
-
•
Democratization of research exists on a spectrum and must be customized to each organization's context, risk tolerance, and regulatory environment.
-
•
Not all research tasks should be democratized; high-risk or unclear problems require specialist researcher involvement.
-
•
AI tools are enabling broader roles for PMs and designers, allowing faster prototyping and product documentation, blurring specialist boundaries.
-
•
Effective democratization requires elegant guardrails to protect participant safety, data privacy, and research quality.
-
•
Democratization can massively increase organizational research capacity, as Flight Center’s example shows, tripling volume while maintaining quality.
-
•
Training and certification are critical to enable non-researchers to run low-risk studies effectively and ethically.
-
•
Bias awareness and anti-bias training are essential components of democratization to maintain the integrity of insights.
-
•
A democratization charter outlining who can conduct research, with which audiences and methods, helps set clear expectations and governance.
-
•
Research maturity assessment helps determine an organization's readiness for democratization and identifies needed upskilling.
-
•
Research quality control currently relies on script review and coaching but is evolving toward AI-supported automatic quality feedback.
Notable Quotes
"Democratization is here to stay, and it’s a positive force for good in product development."
"The democratization spectrum ranges from everyone accessing feedback to a free-for-all, but I don’t advocate for a free-for-all."
"We need elegant guardrails to keep the business safe, keep participants safe, and make democratization ethical."
"Flight Center went from 10 researchers running research to over 130 people trained to safely do interviews."
"When done right, democratization multiplies the impact of research rather than diluting it."
"The goal is to lower the floor for who can access research while raising the ceiling of what’s possible."
"It should be as easy to run research as brushing your teeth."
"AI will soon enable us to automatically flag leading questions and coach researchers for quality."
"Not every problem needs research; sometimes it’s fine to ship quickly and learn after."
"Training non-researchers in bias awareness and methodology is essential to prevent poor data and insights."
Or choose a question:
More Videos
"I was talking with a person who said I’m like an idea machine, a 24-7 idea machine. The reply was immediate. It isn’t, you get used up and spat out."
Dr. Karl JeffriesThe Science of Creativity for DesignOps
January 8, 2024
"You have to understand how the business actually makes money to align UX with it."
Amy MarquezINVEST: Discussion
June 15, 2018
"Building an internal research practice is critical for long-term value and integration of insights."
Steve Portigal Chris Chapo Kelly Goto Christian RohrerDiscussion
May 13, 2015
"Some needs proved full-time, so hybrid staffing models are often short term or mixed part-time."
Alicia MootyDesign Staffing Models
September 30, 2021
"The only rule is to maintain your smile and just to feel the being that have fun."
Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt LaurenceThe Authentic UX Talent Show
January 8, 2024
"We can’t complain about not having a seat at the table if we don’t offer one of our own."
Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne RogondinoTheme 1: Discussion
January 8, 2024
"Most organizations don’t have one research tool, but a mix, so openness and integration are essential."
Sofia QuinteroThe Product Philosophy Behind EnjoyHQ
March 10, 2021
"Lawyers, though nervous, can become some of the most reasonable people you deal with if you explain risks clearly."
Laura KleinUnique challenges of innovation in enterprises
April 23, 2020
"You’ve got to take control of the backlog and position your team as value-driven, not just servicing individual teams."
Andrew MichaelBuilding a Product Insights Team
March 10, 2022