Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Jon Fukuda
Design Planning and Management Support
2023 • DesignOps Summit 2023
Gold
Jane Davis
Strategic Shifts and Innovations in User Research: Navigating Challenges and Opportunities
2025 • Advancing Research 2025
Gold
Katie Hansen
Experimental research: techniques for deep, psychology-driven insights
2025 • Advancing Research 2025
Gold
Meredith Black
Building Community and Common Trends to Look for in 2021
2020 • DesignOps Community
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Trisha Terhar
Empathizing with the Empowered: Non-Researcher Responses to Democratization
2022 • Advancing Research 2022
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
Cennydd Bowles
Responsible Design in Reality
2021 • Design at Scale 2021
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Weidan Li
Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
Soma Ghosh
What emerging methods are advancing UX research [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Steve Chaparro
Bringing Into Alignment Brand, Culture and Space
2020 • DesignOps Community
Greg Petroff
The Compass Mission
2021 • Advancing Research 2021
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • Advancing Research 2022
Gold
Amanda Kaleta-Kott
The Joys and Dilemmas of Conducting UX Research with Older Adults
2022 • Advancing Research 2022
Gold

More Videos

Daniel J. Rosenberg

"The AI is looking through material and that material’s changing every day."

Daniel J. Rosenberg

Designing with and for Artificial Intelligence

August 11, 2022

Dan Mall

"A key metric for a successful design system is how early the design system team is invited into project conversations."

Dan Mall

“Ask Me Anything” with Dan Mall, Author of Upcoming Rosenfeld Title, Design that Scales

October 2, 2023

Peter Morville

"Changing culture is hard because we’re willing to change actions but resistant to changing beliefs."

Peter Morville

The Architecture of Understanding

May 13, 2015

Kyria Stephens

"Gunshots were a routine sound growing up. We became numb to it."

Kyria Stephens Marlon Kerner

Power to Heal: Civic Design in the Aftermath of Tragedy

November 17, 2022

Nathan Shedroff

"Most business tools focus on quantitative value and are terrible at capturing qualitative value, where design lives."

Nathan Shedroff

Redefining Value: Bridging the Innovation Culture Divide

May 14, 2015

Kim Fellman Cohen

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

Kim Fellman Cohen

Measuring the Designer Experience

October 23, 2019

Bria Alexander

"Feedback is data, not personal — once you view it that way, it feels less like criticism and more like improvement information."

Bria Alexander Laura Gatewood Corey Long Daniel Orbach Laine Prokay Deanna Smith

The Big Question about Resilience: A panel discussion

September 23, 2024

Bria Alexander

"Thank you to our sponsors, we could not do this conference without you."

Bria Alexander Louis Rosenfeld

Opening Remarks Day 2

March 26, 2024

Changying (Z) Zheng

"Our approach to career development is thinking about two dimensions: what you’re good at and enjoy, and what you’re good at but don’t enjoy."

Changying (Z) Zheng

Practical DesignOps: From Ideas to Tools That Teams Actually Use

September 25, 2025