Rosenverse
Data-Prompted Interviews

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews

Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • •

    Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • •

    Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • •

    Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • •

    Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • •

    High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • •

    Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • •

    Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • •

    ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • •

    Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • •

    Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Jorge Arango
Exploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
2024 • Rosenfeld Community
Mark Interrante
AI for Prioritization (3rd of 3 seminars)
2024 • Rosenfeld Community
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Maria Taylor
Knowledge is Power: Managing the Lifeblood of the Design Org
2023 • DesignOps Summit 2023
Gold
Nicole Aleong
Future Orientations to Everyday Life: Futures Anthropology as a Methodology
2024 • Advancing Research 2024
Gold
Liza Pemstein
Scaling Research Via an Ops First Model at Clever
2023 • Advancing Research 2023
Gold
Jen Cardello
Learning Velocity—The Insights Speedometer
2021 • Advancing Research Community
Abby Covert
Stuck? Diagrams Help
2022 • DesignOps Community
Hang Xu
Live Sensemaking: How Might We Shape Tools that Extend Us at Every Level, from Product to Workflow to Community?
2026 • Shift UX 2026
Conference
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Meredith Black
Building Community and Common Trends to Look for in 2021
2020 • DesignOps Community
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Dharani Perera
The mandala of service design: unlocking alignment and action through service design
2025 • Advancing Service Design 2025
Gold
Feleesha Sterling
Building a Rapid Research Program
2023 • Enterprise Community
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold

More Videos

Corey Long

"Treat unemployment as a full-time job; be relentless and turn over every stone to improve your chances."

Corey Long

Hiring in DesignOps: A Critical Study on How to Hire and Get Hired

September 23, 2024

Sarah Auslander

"Pay transparency within organizations is critical for enabling good work and healthier working conditions."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022

Lisa Welchman

"People can have the same values and ideas but if you don’t tune them properly, you just don’t get what you want."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Lena Shenkarenko

"Community input is invaluable in crafting solutions that work for everyone."

Lena Shenkarenko

Collaborative Wireframing for Creating Team Alignment and Shipping Better Products

October 21, 2020

Christian Bason

"Empathy in design has been too focused on people and often on standardized personas rather than true diversity and marginalized voices."

Christian Bason

Expand—Rethinking Design for Public Challenges

September 14, 2022

Nicole Umphress

"Unfortunately, that natural, spontaneous connection in person is something we can’t fully replicate virtually; it has to be scheduled and intentional."

Nicole Umphress

Delivering Design Education During a Global Pandemic: Lessons Learned

June 9, 2022

Jim Kalbach

"Empathy in jazz means the band is in it together—when someone plays a wrong chord, the rest adapt and turn it into an opportunity."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

November 6, 2017

Bob Baxley

"Building relationships with our internal partners may well be the highest leverage aspect of our jobs."

Bob Baxley

Theme 4: Intro

January 8, 2024

Megan Campos

"We often center the point of view of dominant demographics and ignore the needs of those we never speak to."

Megan Campos

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research

March 12, 2021

Latest Books All books