Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Speakers: Megan Campos
Link:

Summary

Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.

Key Insights

  • Researchers often undervalue race, ethnicity, gender, and sex in recruitment compared to other demographic criteria like age and location.

  • Homogeneous recruitment pools are usually predominantly white, cisgender, and economically middle class, limiting representativeness.

  • Ignoring demographic diversity risks reinforcing dominant cultural perspectives and missing key user needs and experiences.

  • Demographics such as race and gender significantly shape lived experiences and thus influence how users interact with products and services.

  • Specific and non-flexible demographic quotas improve success in recruiting diverse participants from third-party recruiters.

  • Recruiters often treat demographic criteria as optional, requiring pushback and clear communication to prioritize diversity.

  • Diverse research teams help identify recruitment barriers and blind spots that homogeneous teams may overlook.

  • Recruitment strategies must extend beyond familiar networks and include culturally appropriate outreach to marginalized communities.

  • Even when diversity isn’t the study focus, recruiting representative participants can surface critical differences in experience.

  • Overrepresenting marginalized groups in samples can compensate for historical overrepresentation of dominant groups and reveal nuanced insights.

Notable Quotes

"If we just decide to ignore demographics we're missing huge swaths of the participant experience and an opportunity to better serve our users."

"Demographic criteria is generally considered less important compared to project-specific or contextual criteria in recruitment."

"The viruses don't discriminate based on race, but our healthcare system does."

"We often center the point of view of dominant demographics and ignore the needs of those we never speak to."

"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I want to say they shouldn't be."

"If seeing a diverse participant pool is important to you, it's your responsibility to make sure your recruiters use it as a priority."

"We can't say with certainty what needs or pain points we missed when our recruits weren't demographically diverse."

"Age carries with it obvious visible differences and lived experience, while race often involves less visible but equally impactful structures."

"The best we do should be open to improvement and evolution to better serve clients' target audiences."

"When you have findings that serve smaller populations, it often tends to serve the broader population as well."

Ask the Rosenbot
John Taschek
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Erin Weigel
Get Your Whole Team Testing to Design for Impact
2024 • Rosenfeld Community
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold
Samuel Proulx
Inclusive Research: Debunking Myths and Getting Started
2025 • Advancing Research 2025
Gold
Eduardo Ortiz
Theme 3 Intro
2025 • Advancing Research 2025
Gold
Peter Van Dijck
Hands-on AI #1: Let’s write your first AI eval
2025 • Rosenfeld Community
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Amy Marquez
INVEST: Discussion
2018 • Enterprise Experience 2018
Gold
Jon Fukuda
Theme 3 Intro
2024 • DesignOps Summit 2024
Gold

More Videos

Daniel J. Rosenberg

"You can’t evaluate bias if the AI can’t explain itself."

Daniel J. Rosenberg

Designing with and for Artificial Intelligence

August 11, 2022

Dan Mall

"You have to know what the development roadmap is to ensure design system changes are properly integrated and prioritized."

Dan Mall

“Ask Me Anything” with Dan Mall, Author of Upcoming Rosenfeld Title, Design that Scales

October 2, 2023

Peter Morville

"When we understand organizations as ecosystems, we recognize the need for organic simplicity."

Peter Morville

The Architecture of Understanding

May 13, 2015

Kyria Stephens

"Buffalo is actually designed for incidents like this to happen."

Kyria Stephens Marlon Kerner

Power to Heal: Civic Design in the Aftermath of Tragedy

November 17, 2022

Nathan Shedroff

"The accounting system only showed Instagram’s value at $86 million; the rest was goodwill representing intangible value."

Nathan Shedroff

Redefining Value: Bridging the Innovation Culture Divide

May 14, 2015

Kim Fellman Cohen

"People problems find their way to design ops because we’re known problem solvers and people run to us when morale is low."

Kim Fellman Cohen

Measuring the Designer Experience

October 23, 2019

Bria Alexander

"Our behavior is implicit messaging; we need both explicit and implicit signals to support resilience on teams."

Bria Alexander Laura Gatewood Corey Long Daniel Orbach Laine Prokay Deanna Smith

The Big Question about Resilience: A panel discussion

September 23, 2024

Bria Alexander

"If these two voices don’t work for you, you can reach out at conferences@rosenfeldmedia.com."

Bria Alexander Louis Rosenfeld

Opening Remarks Day 2

March 26, 2024

Changying (Z) Zheng

"Different AI systems have different strengths; Claude is great for creative writing, ChatGPT is concise and to the point, Gemini is deeper for research."

Changying (Z) Zheng

Practical DesignOps: From Ideas to Tools That Teams Actually Use

September 25, 2025