Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Summary
This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.
Key Insights
-
•
Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.
-
•
Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.
-
•
Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.
-
•
Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.
-
•
Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.
-
•
Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.
-
•
Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.
-
•
Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.
-
•
User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.
-
•
Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.
Notable Quotes
"In research, it depends; it’s never yes or no — it really depends on the context and the job."
"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."
"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."
"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."
"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."
"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."
"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."
"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."
"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."
"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."
Or choose a question:
More Videos
"The ultimate measure of our research is its impact—did we build the right thing and did it have the expected effect?"
Robert Fabricant Peter Merholz Noam Segal Teresa TorresA Genuine Conversation about the Future of UX Research
March 20, 2024
"Hiring for lived experience, not just academic credentials, changes the game."
Jennifer StricklandAdopting a "Design By" Method
December 9, 2021
"I hope that today you are transformed."
Victor UdoewaTheme One Intro
March 27, 2023
"Delivery gets missed at the right time often; sequencing, deployment, and adoption planning are critical."
Sean McKayWhole Product Thinking: Expanding beyond problem and solution space thinking
March 14, 2024
"Choosing the right hill to die on is so important and so hard; the problems that matter come around again and again."
Leisa ReicheltOpening Keynote: Operating in Context
November 7, 2018
"Human connection is a basic need that doesn’t get paused just because someone works remotely."
Jilanna WilsonDistributed Design Operations Management
October 23, 2019
"DesignOps needs to work more horizontally to bridge silos between product, marketing, engineering, and research."
Dave Malouf Patrizia Bertini Jon FukudaThe Past, Present, and Future of DesignOps: a 2-part DesignOps Community Call (Part 2)
April 28, 2022
"Sometimes the solution is obvious and doesn’t need a lot of user research time."
Aditi Ruiz Christian Crumlish Farid SabitovA PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
December 6, 2022
"We need the serenity to accept things we cannot change and the courage to change what we can, and the wisdom to know the difference."
Robin Beers Sonja Bobrowska Mujtaba Hameed Josh MoralesHow to create actionable insight in the face of politics and silos [Advancing Research Community Workshop Series]
October 12, 2023
Latest Books All books
Dig deeper with the Rosenbot
How do product risk categories like feasibility, viability, desirability, and usability relate to research method choice?
How does visual mapping handle non-linear system relationships better than spoken language?
What examples from history show grassroots design movements successfully challenging tech monopolies?