Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research

Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Speakers: Megan Campos
Link:

Summary

Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.

Key Insights

  • Researchers often undervalue race, ethnicity, gender, and sex in recruitment compared to other demographic criteria like age and location.

  • Homogeneous recruitment pools are usually predominantly white, cisgender, and economically middle class, limiting representativeness.

  • Ignoring demographic diversity risks reinforcing dominant cultural perspectives and missing key user needs and experiences.

  • Demographics such as race and gender significantly shape lived experiences and thus influence how users interact with products and services.

  • Specific and non-flexible demographic quotas improve success in recruiting diverse participants from third-party recruiters.

  • Recruiters often treat demographic criteria as optional, requiring pushback and clear communication to prioritize diversity.

  • Diverse research teams help identify recruitment barriers and blind spots that homogeneous teams may overlook.

  • Recruitment strategies must extend beyond familiar networks and include culturally appropriate outreach to marginalized communities.

  • Even when diversity isn’t the study focus, recruiting representative participants can surface critical differences in experience.

  • Overrepresenting marginalized groups in samples can compensate for historical overrepresentation of dominant groups and reveal nuanced insights.

Notable Quotes

"If we just decide to ignore demographics we're missing huge swaths of the participant experience and an opportunity to better serve our users."

"Demographic criteria is generally considered less important compared to project-specific or contextual criteria in recruitment."

"The viruses don't discriminate based on race, but our healthcare system does."

"We often center the point of view of dominant demographics and ignore the needs of those we never speak to."

"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I want to say they shouldn't be."

"If seeing a diverse participant pool is important to you, it's your responsibility to make sure your recruiters use it as a priority."

"We can't say with certainty what needs or pain points we missed when our recruits weren't demographically diverse."

"Age carries with it obvious visible differences and lived experience, while race often involves less visible but equally impactful structures."

"The best we do should be open to improvement and evolution to better serve clients' target audiences."

"When you have findings that serve smaller populations, it often tends to serve the broader population as well."

Ask the Rosenbot
Devon Powers
Imagining Better Futures
2022 • Advancing Research 2022
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Victor M. Gonzalez
Practicing Learners and Learning Practitioners
2021 • Advancing Research 2021
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Laura Smith
Embedding Service Design and Agile Practice within UK Planning Teams to Create Services that Last
2024 • Advancing Service Design 2024
Gold
Christopher Noessel
AI of the now: Designing for Agents
2024 • Rosenfeld Community
Changying (Z) Zheng
Practical DesignOps: From Ideas to Tools That Teams Actually Use
2025 • Rosenfeld Community
Shelby Switzer
Making Space for Community Knowledge-sharing in a Distributed World
2021 • Civic Design 2021
Gold
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold
Bria Alexander
The Big Question about Resilience: A panel discussion
2024 • DesignOps Summit 2024
Gold
Allan Lowson
Rehashing the Double Diamond: Collaborating across functions with AI-assisted prototyping
2026 • Designing with AI 2026
Conference
Ash Brown
Silver Linings: What DesignOps Learned in the Shift to WFH
2020 • DesignOps Summit 2020
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How
2021 • Advancing Research Community
Barb Spanton
Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
2022 • Design at Scale 2022
Gold
Mike Brzozowski
UX in everyday products: Empowering climate conscious choices
2024 • Climate UX Interest Group

More Videos

Feyikemi Akinwolemiwa

"In a world of AI where things are speeding up, it's more important than ever to position ourselves as teams that can actually change things."

Feyikemi Akinwolemiwa

Play to innovate: How curiosity and experimentation transform UX

March 11, 2026

Melissa Eggleston

"When you tell the truth, especially hard truths, how you say it matters as much as the truth itself."

Melissa Eggleston Maya Israni Florence Kasule Owen Seely Andrea Schneider

Practical People Skills for Building Trust on Teams and with Partners

December 9, 2021

Jane Reid

"Offering participants food or shelter crosses professional boundaries and can create unsafe expectations."

Jane Reid Janice Hannaway

Self-care in User Research

April 2, 2020

Brian T. O’Neill

"If nobody uses this because they don’t trust it, it doesn’t matter how accurate the model is."

Brian T. O’Neill Maria Cipollone Luis Colin Manuel Dahm Mike Oren

Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?

February 18, 2022

Yoel Sumitro

"Reflection in action involves noticing surprise, questioning assumptions, experimenting, and reflecting on the move."

Yoel Sumitro

Actions and Reflections: Bridging the Skills Gap among Researchers

March 9, 2022

Natalia Radywyl

"Studio Thick’s name refers to thick value — qualitative research with more depth than simple messages."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Kristin Wisnewski

"You can't just jump to the top of the pyramid like Maslow’s hierarchy—you have to consider all the underlying layers supporting the experience."

Kristin Wisnewski

Measuring What Matters

October 23, 2019

Lija Hogan

"Now everyone’s an edge case, so research needs to focus on those edge cases, not just the average user."

Lija Hogan Milan Mijatovic Sam Proulx Louis Rosenfeld

Three Years Out: Perspectives on the Near-Term Future of User Research

March 15, 2024

Amahra Spence

"All organizing is science fiction; it’s about the imaginations we choose to design from."

Amahra Spence

Designing for Liberation, Rehearsing Freedom

November 18, 2022