Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research

Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Community
Sara Conklin
A UXer’s 12-Month Journey from Climate Concern to Climate Credibility
2025 • Climate UX Interest Group
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Deanna Smith
Leading Change with Confidence: Strategies for Optimizing Your Process
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Nick Lewis
Designing and building low-carbon websites independently
2025 • Climate UX Interest Group
Gregg Bernstein
Opportunistic Research with Gregg Bernstein
2019 • Advancing Research Community
Christian Crumlish
The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…
2025 • Rosenfeld Community
Peter Van Dijck
Hands-on AI #2: Understanding evals: LLM as a Judge
2025 • Rosenfeld Community
Isaac Heyveld
Expand DesignOps Leadership as a Chief of Staff
2022 • DesignOps Summit 2022
Gold
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community
Vanessa Varin
Feedback: The Other F-Word
2025 • DesignOps Summit 2025
Gold
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold

More Videos

Joe Meersman

"Design sprints are a rollercoaster of emotion and pressure for everybody."

Joe Meersman Pooria Sohi

Use AI to Drive Outcomes that Go Beyond the Design Sprint

September 25, 2024

Caroline Vize

"We saw one insurance form took 14 minutes to fill, and that was longer than competitor journeys, helping identify a clear target for improvement."

Caroline Vize

The State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022

March 9, 2022

Karen Pascoe

"Most employees take at least 90 days to onboard and another 90 days to become productive — that’s half a year before you see impact."

Karen Pascoe

Developing Experience Teams and Talent in the Enterprise

June 8, 2016

Mandy Drew

"We need to rethink business metrics that reward addiction and instead measure the quality and meaning of user interactions."

Mandy Drew

What Role(s) Can Research Play in Responsible Design?

March 11, 2021

Caroline Jarrett

"Data quality involves accuracy, completeness, uniqueness, timeliness, and representativeness—not just error reduction."

Caroline Jarrett

Garbage in, garbage out? Measuring error rates to get ready for AI

January 8, 2026

Jennifer Strickland

"Empathy is a great goal, but sometimes we have to use the stick and provide checklists for what must be done."

Jennifer Strickland Lesley-Ann Noel

Fireside Chat: How Design Addresses a World on Fire

March 18, 2022

Dave Malouf

"I like to think about individuals as cells, teams as organs, and organizations as organisms in an ecosystem."

Dave Malouf

Theme 3: Introduction and Provocation

January 8, 2024

Nicole Aleong

"Futures anthropology teaches us to separate users' expectations, anticipations, hopes, and speculations about the future."

Nicole Aleong Michaela Mora Prayag Narula Brianna Sylver

What UX research can learn from other research practices [Advancing Research Community Workshop Series]

September 14, 2023

Christian Crumlish

"Have you just asked what scares us or keeps us up at night? Those repeated fears highlight the risks we need to avoid."

Christian Crumlish Wendy Johansson Rich Mironov Aditi Ruiz Adam Thomas

Afternoon Insights Panel

December 6, 2022