Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research

Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Harry Max
Failure Friday #5: Lessons from a SaaS Design Failure
2025 • Rosenfeld Community
Janelle Estes
UX Research Trends
2021 • Advancing Research Community
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • DesignOps Summit 2025
Gold
Ricardo Martins
Unlocking the power of advanced quantitative methods
2025 • Advancing Research 2025
Gold
Smitha Papolu
Theme 3 Discussion
2019 • Enterprise Experience 2019
Gold
Emily Williams
When UX Research and Institutional Racism Collide: A Case Study
2021 • Advancing Research 2021
Gold
Marisa Bernstein
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
2021 • Civic Design 2021
Gold
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Steve Baty
Breaking Out of Ruts: Tips for Overcoming the Fear of Change
2016 • Enterprise UX 2016
Gold
Dan Willis
Enterprise Storytelling Sessions
2017 • Enterprise Experience 2017
Gold
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold
Tricia Wang
From Users to Shapers of AI: The Future of Research
2024 • Advancing Research 2024
Gold
Himanshu Bharadwaj
If design had a heart
2026 • Rosenfeld Community

More Videos

Patrick Boehler

"We spend millions on content that nobody wanted and that didn’t actually help people navigate their lives."

Patrick Boehler

Fishing for Real Needs: Reimagining Journalism Needs with AI

June 10, 2025

Taylor Jennings

"The job market is forcing UX researchers to evolve quickly, becoming strategic thinkers and system creators."

Taylor Jennings Alexis McNutt Unis Sydney Lawson

Research Debate Club

March 11, 2026

Johanna Kollmann

"Design strategy focuses on providing a framework for developing design solutions that support a given product strategy, whereas product strategy addresses the business model, the roadmap, and prioritizing requirements - Frank Guo."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

James Lang

"Early enthusiasm fades; succession planning is key to keeping communities alive."

James Lang

If you can design an app, you can design a community

May 22, 2025

Jason Mesut

"Mask Manipulators appear caring but use guilt and emotional pressure, killing trust and psychological safety."

Jason Mesut Martina Hodges-Schell Jose Coronado

Unmasking Design Leadership: Navigating leadership without neglecting ourselves

October 30, 2025

Nova Wehman-Brown

"I had to ask what wind forms were, which was pretty humbling."

Nova Wehman-Brown

We've Never Done This Before

June 4, 2019

Ian Johnson

"Simple word-list based filters can easily be tricked by misspellings or slight variations in prompts."

Ian Johnson

Latent Scope: Finding structure in unstructured data

June 11, 2025

Mark Interrante

"Assume positive intent from their point of view — they’re trying to have a good day, not work against you."

Mark Interrante

Collaboration Flows in Product Development

June 9, 2017

Tony Turner

"Tags shouldn’t change very often; there should be governance to keep things consistent and relevant."

Tony Turner

Capturing Deep Insights

September 30, 2021