What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Summary
Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.
Key Insights
-
•
Researchers often undervalue race, ethnicity, gender, and sex in recruitment compared to other demographic criteria like age and location.
-
•
Homogeneous recruitment pools are usually predominantly white, cisgender, and economically middle class, limiting representativeness.
-
•
Ignoring demographic diversity risks reinforcing dominant cultural perspectives and missing key user needs and experiences.
-
•
Demographics such as race and gender significantly shape lived experiences and thus influence how users interact with products and services.
-
•
Specific and non-flexible demographic quotas improve success in recruiting diverse participants from third-party recruiters.
-
•
Recruiters often treat demographic criteria as optional, requiring pushback and clear communication to prioritize diversity.
-
•
Diverse research teams help identify recruitment barriers and blind spots that homogeneous teams may overlook.
-
•
Recruitment strategies must extend beyond familiar networks and include culturally appropriate outreach to marginalized communities.
-
•
Even when diversity isn’t the study focus, recruiting representative participants can surface critical differences in experience.
-
•
Overrepresenting marginalized groups in samples can compensate for historical overrepresentation of dominant groups and reveal nuanced insights.
Notable Quotes
"If we just decide to ignore demographics we're missing huge swaths of the participant experience and an opportunity to better serve our users."
"Demographic criteria is generally considered less important compared to project-specific or contextual criteria in recruitment."
"The viruses don't discriminate based on race, but our healthcare system does."
"We often center the point of view of dominant demographics and ignore the needs of those we never speak to."
"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I want to say they shouldn't be."
"If seeing a diverse participant pool is important to you, it's your responsibility to make sure your recruiters use it as a priority."
"We can't say with certainty what needs or pain points we missed when our recruits weren't demographically diverse."
"Age carries with it obvious visible differences and lived experience, while race often involves less visible but equally impactful structures."
"The best we do should be open to improvement and evolution to better serve clients' target audiences."
"When you have findings that serve smaller populations, it often tends to serve the broader population as well."
Or choose a question:
More Videos
"It is my honor and pleasure to welcome each of you to the 2021 Design at Scale Conference."
Bria AlexanderOpening Remarks
June 9, 2021
"Rather than handing off work, our designers and developers work side by side through sketching, testing, and iteration."
Laura Smith Tom GaylerEmbedding Service Design and Agile Practice within UK Planning Teams to Create Services that Last
December 3, 2024
"Expectation describes how things ought to be and reinforces the distinction between the present and what is not yet here."
Nicole AleongFuture Orientations to Everyday Life: Futures Anthropology as a Methodology
March 26, 2024
"When you’re doing a survey, think about if it can be done in a way that is much more accessible."
Samuel MartinCo-Design vs Faux-Design: Navigating the Complexities of Sharing Power in Co-Design
March 27, 2026
"Most note-taking apps aren’t designed with hypertext in mind; they mimic traditional notebooks, which adds friction to linking."
Jorge ArangoExploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
April 19, 2024
"The system encourages growth not just in craft but also in client engagement and team collaboration."
Ignacio MartinezFair and Effective Designer Evaluation
September 25, 2024
"No bee micromanages another; they have different roles and contribute independently but in sync."
Mariesa LenzWhat Beekeeping Taught me about Product Teams
October 29, 2025
"One of the core questions of research strategy is how do you decide what research to do when demand exceeds resources."
Chris Geison Cristen Torrey Eric MahlstedtWhat is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question
March 4, 2021
"Our consultant says we should pivot from business to dog to business to business—what do we do?"
Ted NewardTheme 4: Enterprise Organizational Journey
June 4, 2019
Latest Books All books
Dig deeper with the Rosenbot
What are the benefits and challenges of pairing engineers and designers in small, focused pods for product development?
What lessons from AI design in public health are transferable to other high-stakes sectors?
How does the Impeccable tool help integrate design critique into live production workflows?