Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
Sharon Banh
Reimagining research: What does the field need to grow? [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Erika Flowers
AI-Readiness: Preparing NASA for a Data-Driven, Agile Future
2025 • Designing with AI 2025
Gold
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • DesignOps Summit 2022
Gold
Chris Govias
Perspectives on Civic Design
2021 • Civic Design Community
Kaaren Hanson
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Bud Caddell
DesignOps Community Sensing Session
2021 • DesignOps Community
Llewyn Paine
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
2025 • Advancing Research 2025
Gold
Carol Smith
Operationalizing Responsible, Human-Centered AI
2023 • Enterprise UX 2023
Gold
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Sean Dolan
A Practical Look at Creating More Usable Enterprise Customer Journeys
2019 • Enterprise Community
Noreen Whysel
Short Take #4: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Karen Pascoe
Developing Experience Teams and Talent in the Enterprise
2016 • Enterprise UX 2016
Gold

More Videos

Doug Powell

"Good design is good business."

Doug Powell

Closing Keynote: Design at Scale

November 8, 2018

Mila Kuznetsova

"Make sure children understand they can stop the session at any time, and confirm they really get that."

Mila Kuznetsova Lucy Denton

How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices

March 9, 2022

Sarah Gallimore

"Every parent we talked to had some variation of the question: this exists, can I use it right now? Where was this when I needed to apply?"

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Lada Gorlenko

"Simply asking stakeholders what success looks like for them in a project is a powerful way to start meaningful conversations."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Alnie Figueroa

"Who deals with chaos, ambiguity, and disruption best? It’s us, design operations humans."

Alnie Figueroa

The Future of Design Operations: Transforming Our Craft

September 10, 2025

Landon Barnes

"Statistical significance tells you if a change is likely not random, but it does not tell you if the change matters to your business."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Emily Eagle

"Sometimes we have to murder our darlings—let go of favorite parts to let the story or design grow."

Emily Eagle

Can't Rewind: Radio and Retail

June 3, 2019

Malini Rao

"There is no solid way to control the course of your re-platforming project; being flexible is essential."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Asia Hoe

"At General Assembly, I learned that product management is focused more on outcomes and iterative discovery."

Asia Hoe

Partnering with Product: A Journey from Junior to Senior Design

November 29, 2023