Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
You've probably heard the old adage "correlation does not imply causation" but at some point we've got to say that drinking boiling hot tea and burning our tongues are more than just "strongly correlated". Enter Causal Inference, a collection of techniques for reasoning about the relationship between effects that can be measured and causes that can be identified. It helps us bridge between what we hear when we talk directly to users and what we observe about their behavior at scale and over time. This talk will introduce some of the key techniques in causal inference and how they can be used by UX Researchers and Designers to understand potential users, current users, and the products we might build.
Key Insights
-
•
Causal inference bridges qualitative reasoning about context with quantitative analysis of data.
-
•
Directed acyclic graphs help visualize causal pathways and common pitfalls like confounders and colliders.
-
•
Randomized controlled experiments require random assignment, blinding, and pre-specified hypotheses to measure causal effects reliably.
-
•
Average treatment effect summarizes impact on an entire population, whereas intent-to-treat reveals experiment adherence issues.
-
•
Quasi-experimental methods like regression discontinuity and difference-in-differences allow causal inference when randomization is not possible.
-
•
Matching is an art, relying on context-aware ranges rather than exact numeric equivalence to equate comparison groups.
-
•
Synthetic control methods build counterfactual scenarios when no good control group exists.
-
•
Understanding and designing for interpretability strengthens collaboration between designers and analytics or marketing teams.
-
•
Qualitative research poses valuable questions; quantitative causal inference sharpens and tests these questions.
-
•
Behavioral causes revealed by causal inference may differ from user self-reported reasons, offering deeper insights.
Notable Quotes
"Correlation doesn’t imply causation, but sometimes two things happening together do imply a causal mechanism."
"Qualitative reasoning about causal mechanisms usually comes from lived experience, either the researcher or participants."
"Designers have a hard time interpreting econometrics-driven quantitative research without bridging approaches."
"Random assignment to treatment or control is essential—if it’s not random, it’s not a true experiment."
"If you cannot remove a treatment, it may not be a true cause."
"Matching is very much an art, not a science; there are no hard and fast rules for what counts as a good match."
"Difference-in-differences lets you study treatment effects in groups that start in very different places by looking at trends."
"Synthetic controls create counterfactuals using historical data when no suitable control group exists."
"Qualitative research really poses questions; quantitative methods let you investigate those questions rigorously."
"You don’t want to overdesign just to make something more data interpretable because that can lead you down a dark path."
Or choose a question:
More Videos
"Polarity mapping forces you to balance two things that seem like opposites but are actually interdependent."
Boon Yew ChewMaking Sense of Systems—and Using Systems to Make Sense of the Enterprise
June 6, 2023
"Mixed methods research, combining qualitative and quantitative, gives the fullest understanding of customer experience."
Landon BarnesAre My Research Findings Actually Meaningful?
March 10, 2022
"Leaders spend a lot of time on operational work, which does not allow design strategy to mature."
Patrizia Bertini Alexandra Mengoni LeónPushing DesignOps’ Influence into New Global Markets
September 9, 2022
"System thinking is the cornerstone competency of design operations."
Jacqui FreyScale is Social Work
March 19, 2020
"Find somebody else with a really big problem and go solve it for them using your tools. Don’t even talk about what design is."
Robert SchwartzWe're Here for the Humans
June 9, 2017
"I traded my butch boots for kitten heels when interviewing scientists who adhere to biblical beliefs of creationism."
Tamara HaleWar Stories LIVE! Tamara Hale
March 30, 2020
"A kickback is a free flowing and life giving gathering that transforms and electrifies throughout the night."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"Synthetic personas created with AI are a horrible substitute for real user research."
Dave Hoffer Joanne WeaverUX Job Search AMA #3 with Joanne Weaver and Dave Hoffer
July 16, 2025
"Rapid research programs enable designers to submit research questions and feel empowered to participate actively in the research process."
Feleesha SterlingBuilding a Rapid Research Program
May 18, 2023
Latest Books All books
Dig deeper with the Rosenbot
How does intrinsic motivation play a critical role in committing to an academic career in ethics despite job market challenges?
How does AI help maintain UI consistency across multiple development teams in large enterprises?
What are the differences between tribal, campfire-style knowledge sharing and centralized library knowledge management?