Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Casual Inference
Friday, October 6, 2023 • QuantQual Interest Group
Share the love for this talk
Casual Inference
Speakers: Joshua Noble
Link:

Summary

You've probably heard the old adage "correlation does not imply causation" but at some point we've got to say that drinking boiling hot tea and burning our tongues are more than just "strongly correlated". Enter Causal Inference, a collection of techniques for reasoning about the relationship between effects that can be measured and causes that can be identified. It helps us bridge between what we hear when we talk directly to users and what we observe about their behavior at scale and over time. This talk will introduce some of the key techniques in causal inference and how they can be used by UX Researchers and Designers to understand potential users, current users, and the products we might build.

Key Insights

  • Causal inference combines quantitative data analysis with qualitative insights to understand user behavior better.

  • Establishing a causal relationship often begins with qualitative reasoning and hypotheses about causal mechanisms.

  • Quantitative analysis is critical but must be supported by a solid qualitative understanding of the context.

  • True experiments require random assignment and controlled conditions to determine causal effects accurately.

  • Confounders can obscure the understanding of causal relationships, requiring careful consideration in study design.

  • Causal inference techniques include regression analysis, matching, and synthetic controls, each applicable in different contexts.

  • Understanding the relationships between variables is key for effective product and service design.

  • Causal reasoning helps designers articulate the impact of their work on user behavior and outcomes.

  • It is essential to measure the effects of interventions on different user groups to understand personalized design needs.

  • Effective collaboration between designers and data analysts is crucial for interpreting data meaningfully.

Notable Quotes

"There's a double bridging going on here, bringing quantitative thinking to design problems and design thinking to quantitative problems."

"Causal inference is reasoning about relationships and identifying causes and effects."

"When you do causal inference, you very much bridge between quantitative and qualitative thinking."

"Causal inference isn't really a field unto itself. It's borrowing from epidemiology, economics, and data science."

"Qualitative research helps set context and poses questions that can't be answered by numbers alone."

"It's important to understand your users and the context of the interventions being studied."

"We need to think about the causal mechanisms at play when analyzing user behavior."

"The replication crisis in social science highlights the need for rigorous experimental design."

"As designers, we should ask questions about how we can measure the effectiveness of our designs."

"Causal inference is another tool to frame inquiry, which can enhance design processes."

More Videos

Julie Gitlin

"Executive sponsorship is essential for scaling design thinking across the organization."

Julie Gitlin Esther Raice

Design as an Agent of Digital Transformation at JPMC

June 9, 2021

Rachael Dietkus, LCSW

"There are neurobiological changes that people experience when they have experienced trauma, regardless of formal diagnosis."

Rachael Dietkus, LCSW Uday Gajendar Dr. Dawn Emerick Dawn E. Shedrick, LCSW

Leading through the long tail of trauma

July 13, 2022

Louis Rosenfeld

"Don't write a book for the royalties; focus instead on contributing to the field."

Louis Rosenfeld

Coffee with Lou: Should You Write a (UX) Book?

March 7, 2024

Sarah Gallimore

"I urge you to consider life before place and consider place before technology."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

John Donmoyer

"It's important to know what good looks like before you begin a project."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Bria Alexander

"The stories you'll hear today reflect the world we live in and the concept of resilience."

Bria Alexander

Theme 1 Intro

September 23, 2024

JJ Kercher

"The art of flow diagrams and information architecture artifacts is vital."

JJ Kercher

A Roadmap for Maturing Design in the Enterprise

June 15, 2018

Bria Alexander

"You're gonna get the importance of empathy to the bottom line"

Bria Alexander

Theme Two Intro

September 8, 2022

Lukas Moro

"I'm a designer and prototyper focusing on building empowering interfaces."

Lukas Moro

“Feels Like Paper!”: Interfacing AI through Paper

June 11, 2025