Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Casual Inference (Videoconference)
Friday, October 6, 2023 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Casual Inference (Videoconference)
Speakers: Joshua Noble
Link:

Summary

You've probably heard the old adage "correlation does not imply causation" but at some point we've got to say that drinking boiling hot tea and burning our tongues are more than just "strongly correlated". Enter Causal Inference, a collection of techniques for reasoning about the relationship between effects that can be measured and causes that can be identified. It helps us bridge between what we hear when we talk directly to users and what we observe about their behavior at scale and over time. This talk will introduce some of the key techniques in causal inference and how they can be used by UX Researchers and Designers to understand potential users, current users, and the products we might build.

Key Insights

  • Causal inference combines quantitative data analysis with qualitative insights to understand user behavior better.

  • Establishing a causal relationship often begins with qualitative reasoning and hypotheses about causal mechanisms.

  • Quantitative analysis is critical but must be supported by a solid qualitative understanding of the context.

  • True experiments require random assignment and controlled conditions to determine causal effects accurately.

  • Confounders can obscure the understanding of causal relationships, requiring careful consideration in study design.

  • Causal inference techniques include regression analysis, matching, and synthetic controls, each applicable in different contexts.

  • Understanding the relationships between variables is key for effective product and service design.

  • Causal reasoning helps designers articulate the impact of their work on user behavior and outcomes.

  • It is essential to measure the effects of interventions on different user groups to understand personalized design needs.

  • Effective collaboration between designers and data analysts is crucial for interpreting data meaningfully.

Notable Quotes

"There's a double bridging going on here, bringing quantitative thinking to design problems and design thinking to quantitative problems."

"Causal inference is reasoning about relationships and identifying causes and effects."

"When you do causal inference, you very much bridge between quantitative and qualitative thinking."

"Causal inference isn't really a field unto itself. It's borrowing from epidemiology, economics, and data science."

"Qualitative research helps set context and poses questions that can't be answered by numbers alone."

"It's important to understand your users and the context of the interventions being studied."

"We need to think about the causal mechanisms at play when analyzing user behavior."

"The replication crisis in social science highlights the need for rigorous experimental design."

"As designers, we should ask questions about how we can measure the effectiveness of our designs."

"Causal inference is another tool to frame inquiry, which can enhance design processes."

More Videos

John Maeda

"I'm the guy preventing you from all the beer."

John Maeda

Making Sense of Enterprise UX

June 9, 2016

Indi Young

"It’s essential to approach thinking styles without prior demographic assumptions."

Indi Young

Thinking styles: Mend hidden cracks in your market

January 8, 2025

Chris Chapo

"What if design teams and data teams could partner up to solve big customer problems?"

Chris Chapo

Data Science and Design: A Tale of Two Tribes

May 13, 2015

Elizabeth Churchill

"Public displays foster engagement and trust among teams."

Elizabeth Churchill

Exploring Cadence: You, Your Team, and Your Enterprise

June 8, 2017

Rusha Sopariwala

"Collectives are communities of practice individuals that have an interest in a particular topic."

Rusha Sopariwala

Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+

June 9, 2022

George Aye

"Not every project needs a response, nor does every RFP need a proposal."

George Aye

That Quiet Little Voice: When Design and Ethics Collide

November 16, 2022

Ariba Jahan

"As leaders, we need to cultivate our own resilience so that we can nurture our teams."

Ariba Jahan

Team Resiliency Through a Pandemic

January 8, 2024

Julie Gitlin

"Navigating the organization takes time and effort; understanding stakeholder dynamics is crucial."

Julie Gitlin Esther Raice

Design as an Agent of Digital Transformation at JPMC

June 9, 2021

Matteo Gratton

"We should help our users follow a process and understand what could be useful for us and why."

Matteo Gratton

Can Data and Ethics Live Together?

October 1, 2021