Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research

Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Charlotte Vorbeck
Pipeline to Civic Design
2021 • Civic Design 2021
Gold
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge
2019 • Advancing Research Community
Kate Towsey
Shaping the future of research ops: Expanding roles and strategies for a more integrated research ecosystem
2025 • Advancing Research 2025
Gold
Meghan Bausone
Systems Thinking and Design Innovation: Working with Leverage Points in Rural Maternal Health Systems
2026 • Rosenfeld Community
Victor Udoewa
Theme One Intro
2023 • Advancing Research 2023
Gold
Mandy Drew
What Role(s) Can Research Play in Responsible Design?
2021 • Advancing Research 2021
Gold
Shipra Kayan
How Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro 
2021 • DesignOps Summit 2021
Gold
Molly Fargotstein
Multipurpose Communication & UX Research Marketing
2019 • DesignOps Community
Kurdin Bazaz
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Vincent Brathwaite
Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams
2020 • DesignOps Summit 2020
Gold
Kim Fellman Cohen
Measuring the Designer Experience
2019 • DesignOps Summit 2019
Gold
Nalini Kotamraju
Research After UX
2024 • Advancing Research 2024
Gold
Kaitlin Tasker
Fast and Fearless Inclusive Research
2023 • Advancing Research 2023
Gold
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Sarit Geertjes
People, not Petri Dishes: Stories from a Research Recruiter
2019 • DesignOps Community

More Videos

Candace Myers

"We needed a mechanism for scaling The Architects influence and craft to the team, exposing the team to their talents while being inclusive of different points of view."

Candace Myers

Standardizing Design at Scale

September 9, 2022

Bruce Gillespie

"Weave in great user stories that exemplify your key points to maximize engagement."

Bruce Gillespie

Learning from journalism: Balancing impactful communication with compassionate storytelling

March 13, 2025

Rittika Basu

"Helper texts appear when hovering on unfamiliar features, explaining what buttons or controls do."

Rittika Basu

Age and Interfaces: Equipping Older Adults with Technological Tools

February 23, 2023

Dave Hoffer

"Being authentic and sharing what makes you different is what really stands out."

Dave Hoffer Joanne Weaver

UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer

April 3, 2025

Rima Campbell

"UX assets are our business assets."

Rima Campbell Amrit S Bhachu

Increase Productivity and Drive Business Impact

September 24, 2024

Jose Coronado

"We hired a digital recruiter not to become a designer, but to bridge gaps between design and recruiting."

Jose Coronado

From Zero to Hero

September 8, 2022

Cheryl Platz

"Not everyone is comfortable with the physical side of improv, and that's totally fine—mental exercises also build core skills."

Cheryl Platz

Merging Improv with Design

March 7, 2019

Catt Small

"Creating different formats of the vision for different stakeholders improves resonance and adoption."

Catt Small

Craft a Vision that Actually Gets Shipped

April 30, 2026

Bob Baxley

"Design is open source; everybody participates, but you need facilitation to make good on that promise."

Bob Baxley Sara Asche Anderson Sharon Bautista Frank Duran Jamie Kaspszak Abbey Smalley Sylas Souza

Theme 4: Discussion

January 8, 2024