Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
Gold
Tuesday, March 31, 2020 • Advancing Research 2020
Share the love for this talk
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
Speakers: Sohit Karol
Link:

Summary

Millions of listeners around the world use Spotify to listen to audio experiences that are personalized to their taste, yet relevant in the broader cultural context. Spotify is a unique product because unlike many other eyes the first app, a majority of Spotify experience is phenomenological – it happens in listeners’ ears, minds and bodies, after they hit “Play”. Why do people form Meaningful Connections™ with some type of audio content, but not all, and how do we ensure that our ML models respect the nuances of what makes listening to music and podcasts enjoyable? This talk will shed light on such topics and leave the audience with ideas, challenges and possible best practices for using Mixed Methods Research in the age of ML to build delightful product experiences.

Key Insights

  • Machine learning has shifted from backend tech to a frontline role shaping consumer experiences like music recommendations.

  • Spotify personalizes not just music content but also merchandising and UI elements like playlist covers and home screen layout.

  • Music preferences are deeply contextual, changing by time of day, activity, and listener persona.

  • The assumption that skipping a song is a purely negative signal is often incorrect; skip behavior varies by user goals and trust.

  • Mixed methods research at Spotify combines data science, qualitative user research, and now increasingly machine learning itself.

  • Personas such as 'Nick' (curators) and 'Shelley' (casual listeners) help segment skip behaviors and user needs effectively.

  • Editorial playlists blend human curation with ML personalization, balancing communal music experience and individual taste.

  • Contextual factors, including social and environmental considerations, greatly influence music listening behavior and signal interpretation.

  • User mental models around music and playlists differ significantly across personas and impact engagement and skipping.

  • User research teams at Spotify have grown significantly, highlighting the rising importance of research in ML-driven product development.

Notable Quotes

"Machine learning used to be backend technology, but now millions of consumer experiences are decided by machines or algorithms."

"These playlists have some element of machines recommending music in addition to editors behind the scenes."

"There’s been a fundamental shift in consumer products in the last five years driven by machine learning."

"Skipping a song is one of the most common user behaviors and is often assumed to be a bad thing."

"We showed that a skip is not a skip — it varies based on listener goals and trust in the playlist."

"Human behavior is complex and machine learning models need to understand those nuances."

"We consider machine learning as the third leg of mixed methods research, alongside data science and user research."

"Music is personal but also cultural and communal, which creates complexity for personalization."

"Personas like Nick and Shelley help us understand different user attitudes towards music listening and skipping."

"There hasn’t been a better time to be a user researcher, especially in machine learning enabled experiences."

Ask the Rosenbot
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Christian Rohrer
Insight Types That Influence Enterprise Decision Makers
2015 • Enterprise UX 2015
Gold
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Peter Merholz
The Trials and Tribulations of Directors of UX
2023 • Enterprise Community
Eduardo Ortiz
Theme 3 Intro
2025 • Advancing Research 2025
Gold
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • DesignOps Summit 2025
Gold
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Tutti Taygerly
Videconference: How to Work with Difficult People with Tutti Taygerly
2020 • Enterprise Community
Ovetta Sampson
Turning UX Passion into Real Product Influence
2023 • Enterprise UX 2023
Gold
Jon Fukuda
Theme 3 Intro
2024 • DesignOps Summit 2024
Gold
World Usability Day Panel Discussion
2022 • DesignOps Community
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion
2021 • DesignOps Community
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Marc Fonteijn
First Insights from the 2025 Service Design Salary(+) Report
2024 • Advancing Service Design 2024
Gold

More Videos

Nicole Aleong

"Management consultants sell solutions to problems, not just research data, which is why they command high fees."

Nicole Aleong Michaela Mora Prayag Narula Brianna Sylver

What UX research can learn from other research practices [Advancing Research Community Workshop Series]

September 14, 2023

Laura Klein

"Innovation is very much a team sport."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Erin Weigel

"Everything is an experiment."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024

Changying (Z) Zheng

"Once we treat AI as intelligence, we face questions about trust, collaboration, and decision making."

Changying (Z) Zheng

Navigating Innovation with Integrity

September 25, 2024

Dagmara Kukawka

"Teams openly said they didn’t know how to ask questions before and discovered research is cool afterwards."

Dagmara Kukawka

Tiny team, moonshot impact: Democratizing research across continents

March 10, 2026

Elana Chapman

"Participants are usually very forgiving if you’re not a perfect screen reader as long as you explain what you’re doing."

Elana Chapman Li Wen Huang Divyen Sanganee Annabel Weiner

Getting started with accessibility research

February 20, 2025

Iain McMaster

"When product says no to design, it’s not personal—it’s about prioritization and what’s most urgent right now."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023

Ian Swinson

"If you’re amazing at your job but no one listens to your research or design, does it really have impact?"

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Paula Bach

"Collecting habit path data in every study over time builds a data set that informs product decisions."

Paula Bach

Improving Legacy Software: How Much Better Does it Have to Be?

March 11, 2022