Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Casual Inference
Summary
Enter Causal Inference, a collection of techniques for reasoning about the relationship between effects that can be measured and causes that can be identified. It helps us bridge between what we hear when we talk directly to users and what we observe about their behavior at scale and over time.
This talk will introduce some of the key techniques in causal inference and how they can be used by UX Researchers and Designers to understand potential users, current users, and the products we might build.
Key Insights
-
•
Causal inference bridges qualitative reasoning about context with quantitative analysis of data.
-
•
Directed acyclic graphs help visualize causal pathways and common pitfalls like confounders and colliders.
-
•
Randomized controlled experiments require random assignment, blinding, and pre-specified hypotheses to measure causal effects reliably.
-
•
Average treatment effect summarizes impact on an entire population, whereas intent-to-treat reveals experiment adherence issues.
-
•
Quasi-experimental methods like regression discontinuity and difference-in-differences allow causal inference when randomization is not possible.
-
•
Matching is an art, relying on context-aware ranges rather than exact numeric equivalence to equate comparison groups.
-
•
Synthetic control methods build counterfactual scenarios when no good control group exists.
-
•
Understanding and designing for interpretability strengthens collaboration between designers and analytics or marketing teams.
-
•
Qualitative research poses valuable questions; quantitative causal inference sharpens and tests these questions.
-
•
Behavioral causes revealed by causal inference may differ from user self-reported reasons, offering deeper insights.
Notable Quotes
"Correlation doesn’t imply causation, but sometimes two things happening together do imply a causal mechanism."
"Qualitative reasoning about causal mechanisms usually comes from lived experience, either the researcher or participants."
"Designers have a hard time interpreting econometrics-driven quantitative research without bridging approaches."
"Random assignment to treatment or control is essential—if it’s not random, it’s not a true experiment."
"If you cannot remove a treatment, it may not be a true cause."
"Matching is very much an art, not a science; there are no hard and fast rules for what counts as a good match."
"Difference-in-differences lets you study treatment effects in groups that start in very different places by looking at trends."
"Synthetic controls create counterfactuals using historical data when no suitable control group exists."
"Qualitative research really poses questions; quantitative methods let you investigate those questions rigorously."
"You don’t want to overdesign just to make something more data interpretable because that can lead you down a dark path."
Or choose a question:
More Videos
"Soap dispensers and water sensors often fail on darker skin because they rely on light reflection."
Nancy DouyonWe'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
June 15, 2018
"We help teams onboard their coded components onto the UXPin platform so they can be enabled with component-driven prototyping."
Jack BeharHow to Build Prototypes that Behave like an End-Product
December 6, 2022
"A design project can become the catalyst for conversations where teams realize they have not talked to each other."
Jorge ArangoMeeting of the Waters: Designing for Successful Inorganic Growth
August 12, 2021
"Don’t try to tag all historical work at once — tag as you go to avoid re-platforming nightmares."
Jon White Erin MayUnsticking Research for Better Information Flow
March 11, 2026
"Designing in enterprise means facilitating conversations and educating your teams because many stakeholders don’t speak design."
Jessamyn EdwardsSurviving Your UX Career in Enterprise Design
December 2, 2021
"Designers embedded alongside technical teams can spot unseen issues in the spaces between operational silos."
Stefanie OwensOptimizing for Outcomes: Transformation Design in Systems at Scale
December 4, 2024
"I’m just trying to get the kid a coat, I don’t need it on my resume."
Ron BronsonDesign, Consequences & Everyday Life
November 18, 2022
"We do about a hundred free community sessions a year where anyone with membership can attend."
Louis RosenfeldThe Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
June 5, 2024
"Collaboration is not just beneficial, it's essential for effective climate action."
Ash BrownSilver Linings: What DesignOps Learned in the Shift to WFH
October 23, 2020
