Summary
Millions of listeners around the world use Spotify to listen to audio experiences that are personalized to their taste, yet relevant in the broader cultural context. Spotify is a unique product because unlike many other eyes the first app, a majority of Spotify experience is phenomenological – it happens in listeners’ ears, minds and bodies, after they hit “Play”. Why do people form Meaningful Connections™ with some type of audio content, but not all, and how do we ensure that our ML models respect the nuances of what makes listening to music and podcasts enjoyable? This talk will shed light on such topics and leave the audience with ideas, challenges and possible best practices for using Mixed Methods Research in the age of ML to build delightful product experiences.
Key Insights
-
•
Machine learning algorithms are increasingly central to creating consumer experiences.
-
•
User researchers play a crucial role in understanding the complexities of human behavior that algorithms must accommodate.
-
•
Personalization in music involves balancing algorithmic recommendations with editorial insights.
-
•
User personas are essential for tailoring music experiences to different listener types.
-
•
Different contexts (like driving or social events) significantly impact how users interact with technology.
-
•
Skipping songs may not uniformly indicate dissatisfaction; user goals vary by persona.
-
•
The integration of mixed methods research enhances the development process for machine learning applications.
-
•
User researchers are increasingly recognized as necessities within machine learning teams.
-
•
There’s a growing demand for user research, reflecting its importance in tech industries today.
-
•
Cross-functional collaboration between user researchers and machine learning engineers leads to better user experiences.
Notable Quotes
"We are slowly embarking in a world where algorithms decide many of our consumer experiences."
"There was an old world where DJs decided what songs we listened to; now, it’s machines."
"User research has to be the backbone of machine learning experiences."
"Skips are not simply bad things; they tell us complex stories about user interaction."
"Human behavior is notoriously complex and needs to inform machine learning models."
"The definition of mixed methods research needs to be reconsidered."
"We have moved to a model where customer testing happens early and often in the process."
"There hasn't been a better time to be a user researcher than now."
"The responsibility we have at Spotify is to provide the best listening experience."
"Good predictions lead to great personalized playlists."
















More Videos

"Don't try to solve for the system, try to understand the request."
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018

"Human connection is a basic and evolutionary need; without it, we struggle to foster resilience."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024

"Confirmation bias makes it harder to be open-minded when interpreting research data."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022

"Please read our code of conduct to ensure a respectful environment."
Bria AlexanderDay 3 Welcome
September 25, 2024

"When you explore lots of different ideas, you're going to understand the context better."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022

"Don’t underestimate the power of storytelling in conveying users’ needs to stakeholders."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021

"Trust is the foundation of our team's culture and needs to be maintained during changes."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022

"What's the last bad experience you had with another discipline?"
Adrian HowardSturgeon’s Biases
September 25, 2024

"Designers can be a little enigmatic and protective of our work."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023