Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Louis Rosenfeld
Opening Remarks
2022 • Civic Design 2022
Gold
Dean Broadley
Not Black Enough to be White
2024 • DesignOps Summit 2020
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Alëna Iouguina
Designing Systems at Scale
2018 • DesignOps Summit 2018
Gold
Ellen Chisa
The Values of Design
2023 • Design in Product 2023
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young
2019 • Advancing Research Community
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Shahrzad Samadzadeh
What Is My Value? Two Takes and Some Mistakes
2024 • Enterprise Experience 2020
Gold
Harry Brignull
Beyond Clicks and Tricks: Why deceptive design has grown into a regulatory faultline
2026 • Rosenfeld Community
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Erin Weigel
Real-world lessons to improve your conversion rates
2024 • Rosenfeld Community
Louis Rosenfeld
About the Rosenverse
2026 • Rosenfeld Community
Frances Yllana
Theme 2 Intro
2024 • DesignOps Summit 2024
Gold
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold

More Videos

Aaron Stienstra

"Customer experience cannot truly be good if some are left out or excluded, either intentionally or unintentionally."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021

John Donmoyer

"With AI tools, you have to come back and reprompt, it’s not a one-shot operation."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Sheryl Cababa

"Mapping is not just for presentation; it’s a practice to evolve your understanding of a complex problem space."

Sheryl Cababa Alexis Oh

Thinking in systems to address climate with Sheryl Cababa

June 12, 2024

Ariel Kennan

"We helped through Homestat last year to move 690 people into housing."

Ariel Kennan

Building a Design Culture

June 9, 2017

Ignacio Martinez

"Evaluations and promotions can be nebulous and awkward, especially in collaborative design work."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Dave Hora

"Taking a strategic lens means answering: what’s going on here? What do we do about it? And how do we align our actions coherently?"

Dave Hora

Advice for Establishing Research

December 8, 2022

Dr. Jamika D. Burge

"We need to ask participants how much time they have and want to contribute to avoid extractive research."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices

September 15, 2022

James Rampton

"Tesla had 150 million lines of code in 2019 and is now replacing hundreds of thousands of lines with AI to improve self-driving features."

James Rampton

The Basics of Automotive UX & Why Phones Are a Part of That Future

July 25, 2024

Kristin Wisnewski

"This circle represents the size of IBM, 385,000 IBMers. The CIO team is only 3% of that, and our design team is just 1% of the CIO."

Kristin Wisnewski

Measuring What Matters

October 23, 2019