Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Jon Fukuda
Theme 3 Intro
2024 • DesignOps Summit 2024
Gold
Saara Kamppari-Miller
Inclusive Design is DesignOps
2021 • DesignOps Summit 2021
Gold
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Gold
Michelle Morrison
Culture Design
2020 • DesignOps Community
Bria Alexander
Day 1 Panel: Up to the Minute: The latest in AI’s impact on UX
2025 • Designing with AI 2025
Gold
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Sarah Fathallah
A Typology of Participation in Participatory Research
2023 • Advancing Research 2023
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Margot Bloomstein
Fostering Trust in Your Brand and Beyond
2020 • Enterprise Community
Michal Anne Rogondino
Saving Outer Space: The First UX Design System for Our Nation’s Satellites
2024 • Enterprise Experience 2020
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold

More Videos

Randolph Duke II

"I put down my question guide and just talked with Carol."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020

Corey Nelson

"If you were blindsided recently, I’ve been there. I just really appreciated a kind voice because I didn’t hear a single word they said."

Corey Nelson Amy Santee

Layoffs

November 15, 2022

Landon Barnes

"If you measure an infinite number of customers, every change would be statistically significant, but not every change would be meaningful."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Amy Bucher

"We’re often stuck on a hamster wheel of short-term metrics like daily or monthly active users that don’t capture long-term success."

Amy Bucher

Harnessing behavioral science to uncover deeper truths

March 12, 2025

David Sternberg

"The interface you’ve designed is like a landscape shaping the flow of user behavior as water flows through a stream."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025

Deanna Smith

"More frequent change isn't always better; good communication and team pulse are key."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Jennifer Strickland

"Equity is equal outcomes, not just equal access to a bicycle everyone can’t necessarily ride."

Jennifer Strickland

Adopting a "Design By" Method

December 9, 2021

Rachel Posman

"If adding a design program manager gives each designer back even one hour a day, you might make your entire team more efficient."

Rachel Posman John Calhoun

A Closer Look at Team Ops and Product Ops (Two Sides of the DesignOps Coin)

November 19, 2020

Gina Mendolia

"Provoking and reframing perspective helps teams get unstuck by thinking in new and surprising ways."

Gina Mendolia

Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems

December 3, 2024