Summary
Millions of listeners around the world use Spotify to listen to audio experiences that are personalized to their taste, yet relevant in the broader cultural context. Spotify is a unique product because unlike many other eyes the first app, a majority of Spotify experience is phenomenological – it happens in listeners’ ears, minds and bodies, after they hit “Play”. Why do people form Meaningful Connections™ with some type of audio content, but not all, and how do we ensure that our ML models respect the nuances of what makes listening to music and podcasts enjoyable? This talk will shed light on such topics and leave the audience with ideas, challenges and possible best practices for using Mixed Methods Research in the age of ML to build delightful product experiences.
Key Insights
-
•
Machine learning algorithms are increasingly central to creating consumer experiences.
-
•
User researchers play a crucial role in understanding the complexities of human behavior that algorithms must accommodate.
-
•
Personalization in music involves balancing algorithmic recommendations with editorial insights.
-
•
User personas are essential for tailoring music experiences to different listener types.
-
•
Different contexts (like driving or social events) significantly impact how users interact with technology.
-
•
Skipping songs may not uniformly indicate dissatisfaction; user goals vary by persona.
-
•
The integration of mixed methods research enhances the development process for machine learning applications.
-
•
User researchers are increasingly recognized as necessities within machine learning teams.
-
•
There’s a growing demand for user research, reflecting its importance in tech industries today.
-
•
Cross-functional collaboration between user researchers and machine learning engineers leads to better user experiences.
Notable Quotes
"We are slowly embarking in a world where algorithms decide many of our consumer experiences."
"There was an old world where DJs decided what songs we listened to; now, it’s machines."
"User research has to be the backbone of machine learning experiences."
"Skips are not simply bad things; they tell us complex stories about user interaction."
"Human behavior is notoriously complex and needs to inform machine learning models."
"The definition of mixed methods research needs to be reconsidered."
"We have moved to a model where customer testing happens early and often in the process."
"There hasn't been a better time to be a user researcher than now."
"The responsibility we have at Spotify is to provide the best listening experience."
"Good predictions lead to great personalized playlists."
More Videos
"Designers play a key role in shaping the developer experience to enhance productivity in government agencies."
Ed MullenDesigning the Unseen: Enabling Institutions to Build Public Trust
November 16, 2022
"When I suggest that we could be catalysts for robust action, this is what I mean."
Peter LevinSolve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
March 25, 2024
"Don't let anyone tell you how to do OKRs, make decisions based on what works for your team."
Bria Alexander Benson Low Natalya Pemberton Stephanie GoldthorpeOKRs—Helpful or Harmful?
January 20, 2022
"We are stronger when we work together towards a unified goal"
Kate Koch Prateek KalliFlex Your Super Powers: When a Design Ops Team Scales to Power CX
September 30, 2021
"Show them, don’t tell them."
Amy MarquezINVEST: Discussion
June 15, 2018
"Independence is the cornerstone of a Montessori approach."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Resilience should be supported by organizational structures, not just individuals."
Brian MossWhat Does it Mean to be a Resilient Research Team?
March 9, 2022
"If we can strategically target where we need to focus, that's when you get your CFO behind the design organization."
Adel Du ToitGet Your CFO To Say: 'Our Strategic Goal is User Obsession'
June 10, 2022
"Our super strength unlocks greater customer experience quality and efficiency."
Kate Koch Jean-Claire FitschenFlex Your Super Powers: When a Design Ops Team Scales to Power CX
September 29, 2021
