Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Laura Klein
Human vs. machine: Testing AI’s ability to synthesize and analyze research
2026 • Advancing Research 2026
Conference
Ryan Rumsey
Business Influence Without Losing Your Soul
2021 • Enterprise Community
Kate Towsey
Shaping the future of research ops: Expanding roles and strategies for a more integrated research ecosystem
2025 • Advancing Research 2025
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Dave Malouf
Closing Keynote: Amplify. Not Optimize.
2019 • DesignOps Summit 2019
Gold
Saskia Liebenberg
Start Small for Big Impact
2019 • DesignOps Community
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
Luke Wroblewski
Designing AI Applications
2026 • Rosenfeld Community
Louis Rosenfeld
Becoming a Civic Designer: Making the Move from Private to Public Sector
2022 • Civic Design 2022
Gold
Julie Gitlin
Design as an Agent of Digital Transformation at JPMC
2021 • Design at Scale 2021
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Mark Templeton
Creating a Legacy: the ultimate experience
2017 • Enterprise Experience 2017
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold

More Videos

Shahrzad Samadzadeh

"Designers create value by making artifacts and experiences before fully understanding the space."

Shahrzad Samadzadeh

What Is My Value? Two Takes and Some Mistakes

January 8, 2024

Brenna Fallon

"Design your processes around learning. Celebrate especially when you fail—you often learn the most then."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Ruzanna Rozman

"Getting everyone involved early helped reduce the need for me to explain why we do things."

Ruzanna Rozman

Getting in Flow with Your Team

January 8, 2024

Sheryl Cababa

"Optimizing something for ease of use does not mean it’s best for humanity — infinite scroll is a cautionary example."

Sheryl Cababa

Expanding your Design Lens with Systems Thinking

March 28, 2023

Melissa Schmidt

"The Idea Exchange got 40 teams to participate together across design, research, marketing, program management, even legal."

Melissa Schmidt Adam Menter

How UX Research Hit It Big in Las Vegas

June 4, 2019

Nathan Curtis

"The design system is a living, breathing thing that should constantly evolve based on learning and user needs."

Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn Ressel

Discussion

June 9, 2016

Jake Burghardt

"Insight is a claim supported by customer evidence with implications for product development."

Jake Burghardt

Stop wasting research: Create new value with insight summaries

July 9, 2025

Kate Towsey

"If research is going to slow down the product process, most companies will end up releasing those products without doing the research."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Bria Alexander

"No need to take notes — our scribe David Nicholson is capturing detailed session notes and insights for you."

Bria Alexander

Opening Remarks

September 9, 2022