Rosenverse
Data-Prompted Interviews

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews

Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • •

    Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • •

    Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • •

    Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • •

    Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • •

    High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • •

    Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • •

    Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • •

    ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • •

    Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • •

    Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Sarah Barrett
The "How" of Enterprise Information Architecture
2023 • Enterprise UX 2023
Gold
Milan Guenther
The $212 billion ‘so what?’: unlocking impact in development cooperation
2025 • Advancing Service Design 2025
Gold
Gordon Ross
12 Months of COVID-19 Design and Digital Response with the British Columbia Government
2021 • Civic Design 2021
Gold
Lija Hogan
Doing more with more: Lessons from the Front Lines of Democratization
2022 • Advancing Research 2022
Gold
Jenny Price
From Tradition to Transformation: Unlocking Startup Agility in a Legacy Enterprise
2025 • DesignOps Summit 2025
Gold
Sydney Lawson
Anatomy of a Strong User Panel
2026 • Advancing Research 2026
Gold
Candace Myers
Standardizing Design at Scale
2022 • DesignOps Summit 2022
Gold
Simon Wardley
Maps and Topographical Intelligence
2019 • Enterprise Community
Ari Zelmanow
Dark Side of Democratization
2023 • Advancing Research Community
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Tricia Wang
SCALE: Discussion
2018 • Enterprise Experience 2018
Gold
Peter Morville
The Architecture of Understanding
2015 • Enterprise UX 2015
Gold
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Gold

More Videos

Dr. Karl Jeffries

"If you value innovation and design, then you're investing in creativity."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"The culture between buyer and user impacts feature adoption and overall satisfaction."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Visualizing data in a way executives can interpret is key to shifting from I think to I know."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"Involving designers early in the process is crucial to avoid the 'fast-food' model where they feel like order takers."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"We may not have tech prowess but our sticky notes, card sorts, and test reports are our real superpowers."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"Junior team members don’t have to talk directly to executives; working effectively with peers can create grassroots buy-in."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"Choosing a research repository is a big battle in your organization; the right decisions can really help you succeed."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"You are not the first person to try something like this, and they’re typically not looking forward to the next transformation."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"Without Jim, what we're going to see today would have been a lot worse."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books