Rosenverse
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research

Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • •

    Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • •

    Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • •

    Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • •

    Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • •

    Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • •

    Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • •

    Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • •

    Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • •

    User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • •

    Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Lada Gorlenko
Theme 1: Intro
2024 • Enterprise Experience 2020
Gold
Irina Tikhonova
Small Wins, Big Impact: Leveraging and Elevating User Engagement
2021 • Civic Design 2021
Gold
Laine Riley Prokay
Carving a Path for Early Career DesignOps Practitioners
2022 • DesignOps Summit 2022
Gold
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Jilanna Wilson
Distributed DesignOps Management
2019 • DesignOps Community
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Shipra Kayan
How Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro 
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Indra Klavins
A Design Ops Girl in a Dev Ops World
2019 • DesignOps Summit 2019
Gold
Jerome “Axle” Brown
How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon
2021 • Advancing Research 2021
Gold
Meredith Black
Scaling Design Culture
2017 • DesignOps Summit 2017
Gold
Kate Towsey
Participant Recruitment and Management Tools
2026 • Advancing Research 2026
Gold
Elizabeth Churchill
Exploring Cadence: You, Your Team, and Your Enterprise
2017 • Enterprise Experience 2017
Gold
World Usability Day Panel Discussion
2022 • DesignOps Community
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community

More Videos

Dr. Karl Jeffries

"The biggest myth of all is you can't teach creativity."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"Find your senior executive ally who understands design and go talk to them first — it works."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Enterprise UX is still nascent—businesses worldwide are just beginning to figure out where UX fits."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"How do you organize a design team to work within a changing environment without freaking everybody out."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"Research in science fiction helps make research real and creative all the time."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"Field usability testing showed stakeholders immediately how much value UX can add by catching issues before deployment."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"Research isn’t linear; it’s messy and modular, so your tools have to reflect that fluidity."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"Innovation is very much a team sport."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"My playlist changed drastically when my son was born, but data alone wouldn’t explain why."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books