Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
John Paul de Guzman
10k Screens Later: How We Became a Data-Driven Design Organization
2024 • DesignOps Summit 2024
Gold
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Taylor Jennings
Repository Retrospective: Learnings from Introducing a Central Place for UX Research
2022 • Advancing Research 2022
Gold
Anna Nguyen
Why Our Voice of the Customer is Better Than Yours
2022 • Advancing Research 2022
Gold
Ali Jeffery
How DesignOps Helped Enable Wall Street to Work Remotely
2020 • DesignOps Summit 2020
Gold
Malini Rao
Lessons Learned from a 4-year Product Re-platforming Journey
2021 • Design at Scale 2021
Gold
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Daniel Orbach
Zero to One: Co-Creating Operating Models with your Team
2024 • DesignOps Summit 2024
Gold
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Louis Rosenfeld
Day 1 Welcome
2024 • DesignOps Summit 2024
Gold
Lais de Almeida
Designing Data Services
2024 • Advancing Service Design 2024
Gold
Nicole Wright
Democratizing Research at HoneyBook
2022 • Advancing Research 2022
Gold
Dr. Jamika D. Burge
Broad Strokes: Connecting Design, Research, and AI to the World Around Us
2023 • Enterprise UX 2023
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Libby Maurer
Treating Diversity & Inclusion in Hiring as a Design Problem
2019 • Enterprise Community

More Videos

Sheryl Cababa

"Designers need to be facilitators of other people's expertise and knowledge, not just creators of designed things."

Sheryl Cababa

Expanding Your Design Lens with Systems Thinking

February 23, 2023

Caitlyn Hampton

"Compass gave me a one-month runway to transition from content strategist to product designer, and that support was incredible."

Caitlyn Hampton Monica Lee Jina Yoon

Compass 101: Growing Your Career In A Startup World

June 11, 2021

Silke Bochat

"Please don’t delegate hiring to HR—hiring managers must set clear criteria and be personally involved to avoid bias."

Silke Bochat

5 Antifragile Strategies for a DesignOps 2.0

September 23, 2024

Christian Rohrer

"The golden trapezoid of user research combines quantitative behavioral and attitudinal data with field studies for best insights."

Christian Rohrer

Insight Types That Influence Enterprise Decision Makers

May 13, 2015

Jaime Creixems

"If you organize your design system device agnostic, you can update one component with all desktop, mobile, and tablet versions inside."

Jaime Creixems

Best Practices when Creating and Maintaining a Design System

June 7, 2023

Jeff Gothelf

"Adobe’s Kickbox is a fantastic professional development tool, but it doesn’t drive new lines of business."

Jeff Gothelf

Innovation Studios: the Engines of Enterprise Experimentation

May 14, 2015

Josh Clark

"Adventure nav pattern gives users the agency to choose different paths in a feed, rather than consuming a single algorithmic stream."

Josh Clark Veronika Kindred

Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)

February 12, 2025

Sarah Rink

"Remote is a design constraint, but what else can we do with it to improve practice?"

Sarah Rink

Remote User Research: Dos and Don'ts from the Virtual Field

June 11, 2020

Alexandra Schmidt

"The current design education system doesn't always prepare designers for the complexity of enterprise challenges."

Alexandra Schmidt

Enterprise UX Playbook

December 1, 2022