Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Michael Land
Establishing Design Operations in Government
2021 • DesignOps Community
Ivana Ng
Level Up Your Program with ProductOps
2024 • Enterprise Experience 2020
Gold
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Tess Dixon
C'mon Get Happy
2021 • DesignOps Summit 2021
Gold
John Devanney
The Design Management Office
2017 • DesignOps Summit 2017
Gold
Sheryl Cababa
Thinking in systems to address climate with Sheryl Cababa
2024 • Climate UX Interest Group
Jen Briselli
Learning Is The Engine: Designing & Adapting in a World We Can’t Predict
2025 • Rosenfeld Community
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Ariel Kennan
Civic Design in 2022
2022 • Civic Design Community
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Brendan Jarvis
It was the Best of Times. It was the Worst of Times.
2024 • DesignOps Summit 2024
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Liwei Dai
The Heart and Brain of the AI Research
2020 • Advancing Research 2020
Gold
Sabrina Mach
How to Design Your Design Operating Model
2021 • DesignOps Summit 2021
Gold

More Videos

Uday Gajendar

"Helen will bridge AI/ML towards engaging with data scientists to augment humanity with complex data."

Uday Gajendar

Theme Four Intro

June 6, 2023

Jason Mesut

"Academic Purists believe one size fits all, ignoring context and stifling innovation."

Jason Mesut Martina Hodges-Schell Jose Coronado

Unmasking Design Leadership: Navigating leadership without neglecting ourselves

October 30, 2025

Nathan Curtis

"You need to be the connector between people trying to drive decisions and others influencing them."

Nathan Curtis

Beyond the Toolkit: Spreading a System Across People & Products

June 9, 2016

Jemma Ahmed

"Democratization is not research anarchy where anybody can talk to any customer for any reason with no oversight."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Ivana Ng

"If we can teach government partners to be product thinkers, that results in impact that lasts beyond contracts."

Ivana Ng

Level Up Your Program with ProductOps

January 8, 2024

Sam Proulx

"With cloud apps, users don’t get to choose when to upgrade, which challenges maintaining accessibility continuity."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

November 18, 2022

Daniel Gloyd

"Warmth needs scale; if a group is too large, social warmth can break down."

Daniel Gloyd

Designing Warmth

February 26, 2025

Helen Armstrong

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

Helen Armstrong

Augment the Human. Interrogate the System.

June 7, 2023

Kathleen Asjes

"Involving non-researchers firsthand helps them understand research’s complexity and when to bring in experts."

Kathleen Asjes

Research Democratization: the Good, the Bad and the Ugly

March 10, 2022