Rosenverse
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research

Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • •

    Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • •

    Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • •

    Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • •

    Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • •

    Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • •

    Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • •

    Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • •

    Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • •

    User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • •

    Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Laurent Christoph
Scale the impact of DesignOps in 3D: Diligence, Decision, Discipline
2025 • DesignOps Community
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Rob Mitzel
The Tale of Two Companies: Building a Successful UX Practice in a Century-Old Enterprise
2024 • Enterprise Experience 2020
Gold
Briana Thomas
The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
2024 • DesignOps Summit 2024
Gold
Luke Roberts
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Dave Malouf
Closing Keynote: Amplify. Not Optimize.
2019 • DesignOps Summit 2019
Gold
Randolph Duke II
War Stories LIVE! Randy Duke II
2020 • Advancing Research 2020
Gold
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold
Laine Riley Prokay
Carving a Path for Early Career DesignOps Practitioners
2022 • DesignOps Summit 2022
Gold
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
Lavrans Løvlie
Ask me anything – Authors of Service Design: From Insight to Implementation
2025 • Advancing Service Design 2025
Gold
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
Kate Towsey
The State of ResearchOps: More Than Just Theory
2019 • DesignOps Community
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
Ian Johnson
Latent Scope: Finding structure in unstructured data
2025 • Designing with AI 2025
Gold

More Videos

Stephen Anderson

"Psychological safety isn’t created by an initiative but through a thousand tiny habits in language and behavior."

Stephen Anderson

Puzzled? How to Coordinate Humans for Complex Challenges

May 27, 2021

Peter Levin

"Intel’s research on cell phones was unbelievably insightful but the company did nothing because it conflicted with their profit margin and core product beliefs."

Peter Levin

Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility

March 25, 2024

Alastair Simpson

"Exceptional teams are made up of individuals who reach out beyond the traditional boundaries of their own role."

Alastair Simpson

Debunking the Myths of Cross-Disciplinary Collaboration

October 24, 2019

Alicia Mooty

"Splitting people’s allocation across different teams created work-life balance issues requiring more oversight."

Alicia Mooty

Design Staffing Models

September 30, 2021

Louis Rosenfeld

"Evergreen content needs a strong perspective on why the topic matters along with practical examples on how to apply it."

Louis Rosenfeld

Coffee with Lou: Should You Write a (UX) Book?

March 7, 2024

Sarah Fathallah

"Vulnerable communities aren't always carrying signs with the word vulnerability spelled out on their forehead."

Sarah Fathallah

Lessening the Research Burden on Vulnerable Communities

March 30, 2020

Clemens Janssen

"Ops-first means standardizing processes so we can scale and onboard new team members quickly."

Clemens Janssen Jane Davis

Efficiently Scaling Research as a Team of One

March 28, 2023

Chris Hammond

"IBM’s sustainability journey has ebbs and flows, impacted by executive pivots, acquisitions like Envizi, and market pressures."

Chris Hammond

Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"

April 2, 2025

Tom Armitage

"Students won’t just wait for me to give them a workshop anymore. They’re just doing it, and I jump in to help troubleshoot."

Tom Armitage Carla Diana Kanene Ayo Holder

Day 2 Panel: Looking ahead: Designing with AI in 2026

June 11, 2025

Latest Books All books