Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Friday, January 20, 2023 • QuantQual Interest Group
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Context in research is complex, multi-dimensional, and dynamic rather than stable and easily separable from phenomena.

  • Quantitative research treats context as a container to abstract away complexity for generalizability, focusing on a few controlled variables.

  • Qualitative research embraces context's fluidity and social construction to generate thick, contextualized understanding but faces challenges in broader generalization.

  • Balancing uncertainty (lack of information) and complexity (too much information) is a core challenge in combining qual and quant research.

  • Popper’s distinction between context of discovery (qual, inductive) and context of justification (quant, deductive) offers a pragmatic framework for integrating methods.

  • Rich qualitative data helps explain why and how phenomena occur, complementing quantitative data that identifies what is happening.

  • Pragmatism prioritizes practical utility over philosophical differences in epistemology when mixing research paradigms.

  • Innovation and detecting weak signals benefit from qualitative probing and quantitative detection of anomalies.

  • User behaviors, especially informal workarounds and innovations, are often invisible to purely quantitative measures but revealed through qualitative methods.

  • Multiple stakeholders in real-world contexts have divergent interests, making perfect solutions rare; negotiation and social intelligence are essential.

Notable Quotes

"In research, it depends; it’s never yes or no — it really depends on the context and the job."

"The AI system might excel at narrow tasks, but putting things into context — especially tone and holistic understanding — is uniquely human."

"Context is not a container; it’s a continuous, incomplete duality with the people who inhabit it."

"Quantitative research seeks parsimonious models — simple, generalizable explanations that often lose deeper contextual uncertainty."

"Qualitative research embraces complexity, generating thick descriptions to capture as much context as possible without aiming for generalization."

"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."

"The question is not about which paradigm is right, but what works best pragmatically for the problem at hand."

"Innovation often happens in informal workarounds and practices invisible to quantitative data but visible through qualitative observation."

"There’s no perfect truth or solution; it’s about negotiation and deciding what’s good enough for the stakeholders we serve."

"If we balance qualitative depth and quantitative breadth, we get a yin-yang harmony that strengthens research and practice."

Ask the Rosenbot
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Enterprise Community
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Chris Hodowanec
Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner
2022 • Civic Design 2022
Gold
Tutti Taygerly
Make Space to Lead
2021 • Design at Scale 2021
Gold
Rachael Dietkus, LCSW
Everything You Need to Know about the Civic Design 2022 Call for Presentations
2022 • Civic Design Community
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Nathan Shedroff
Redefining Value: Bridging the Innovation Culture Divide
2015 • Enterprise UX 2015
Gold
Kate Kalcevich
Designing inclusively with AI
2024 • Designing with AI 2024
Gold
Wendy Johansson
Be a Product Boss!
2022 • Design in Product 2022
Gold
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Ovetta Sampson
Turning UX Passion into Real Product Influence
2023 • Enterprise UX 2023
Gold
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Victor Udoewa
Research in the Pluriverse
2023 • Advancing Research 2023
Gold
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold

More Videos

Michal Anne Rogondino

"Our modern way of life is actually really dependent on satellites."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Sol Mesz

"Knowing the difference between hands and brains is key to managing expectations."

Sol Mesz

Hands or Brains? How to Hire for Strategy, Strategically

January 8, 2024

Adel Du Toit

"User obsession became a strategic goal after making data available and showing progress to leadership including our CFO."

Adel Du Toit

Get Your CFO To Say: 'Our Strategic Goal is User Obsession'

June 10, 2022

Matt LeMay

"There is no one right way to do things; this is deeply contextual work."

Matt LeMay

You Don’t “Get” Anyone to Do Anything

December 6, 2022

Kaaren Hanson

"Our CEO Brad Smith said, I’m all in on Design for Delight, but no new content — it has to reinforce what we already do."

Kaaren Hanson

Stop Talking, Start Doing

June 9, 2017

Kurdin Bazaz

"The people here want to be here. They want the company and customers to succeed and to change the world."

Kurdin Bazaz Liz Rytting Alex Karr

Culture, DIBS & Recruiting

June 10, 2021

Mackenzie Guinon

"Not everyone can become a great UX researcher, but a great UX researcher can come from anywhere."

Mackenzie Guinon

M.C. Escher’s UX Research Career Ladder

March 9, 2022

Dave Malouf

"Great design happens because of great designing — design is a verb, not just a noun."

Dave Malouf

Closing Keynote: Amplify. Not Optimize.

October 24, 2019

Marisa Bernstein

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

Marisa Bernstein

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

December 9, 2021