Summary
Millions of listeners around the world use Spotify to listen to audio experiences that are personalized to their taste, yet relevant in the broader cultural context. Spotify is a unique product because unlike many other eyes the first app, a majority of Spotify experience is phenomenological – it happens in listeners’ ears, minds and bodies, after they hit “Play”. Why do people form Meaningful Connections™ with some type of audio content, but not all, and how do we ensure that our ML models respect the nuances of what makes listening to music and podcasts enjoyable? This talk will shed light on such topics and leave the audience with ideas, challenges and possible best practices for using Mixed Methods Research in the age of ML to build delightful product experiences.
Key Insights
-
•
Machine learning algorithms are increasingly central to creating consumer experiences.
-
•
User researchers play a crucial role in understanding the complexities of human behavior that algorithms must accommodate.
-
•
Personalization in music involves balancing algorithmic recommendations with editorial insights.
-
•
User personas are essential for tailoring music experiences to different listener types.
-
•
Different contexts (like driving or social events) significantly impact how users interact with technology.
-
•
Skipping songs may not uniformly indicate dissatisfaction; user goals vary by persona.
-
•
The integration of mixed methods research enhances the development process for machine learning applications.
-
•
User researchers are increasingly recognized as necessities within machine learning teams.
-
•
There’s a growing demand for user research, reflecting its importance in tech industries today.
-
•
Cross-functional collaboration between user researchers and machine learning engineers leads to better user experiences.
Notable Quotes
"We are slowly embarking in a world where algorithms decide many of our consumer experiences."
"There was an old world where DJs decided what songs we listened to; now, it’s machines."
"User research has to be the backbone of machine learning experiences."
"Skips are not simply bad things; they tell us complex stories about user interaction."
"Human behavior is notoriously complex and needs to inform machine learning models."
"The definition of mixed methods research needs to be reconsidered."
"We have moved to a model where customer testing happens early and often in the process."
"There hasn't been a better time to be a user researcher than now."
"The responsibility we have at Spotify is to provide the best listening experience."
"Good predictions lead to great personalized playlists."
More Videos
"Leadership is best when people barely know she exists."
John MaedaMaking Sense of Enterprise UX
June 9, 2016
"What we want is for organizations to step away from demographics to understand people as cognitive beings."
Indi YoungThinking styles: Mend hidden cracks in your market
January 8, 2025
"Data should be presented in ways that empower users to make immediate decisions."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"We observed how cultural practices impact technology uptake."
Elizabeth ChurchillExploring Cadence: You, Your Team, and Your Enterprise
June 8, 2017
"We had to put together very intentional and deliberate rituals."
Rusha SopariwalaRemote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
June 9, 2022
"We mostly have something called BYOE, or bring your own ethics, in the design industry."
George AyeThat Quiet Little Voice: When Design and Ethics Collide
November 16, 2022
"I learned that being in the red for one person was crying and for another, it was complete silence."
Ariba JahanTeam Resiliency Through a Pandemic
January 8, 2024
"This isn’t just about design; this is about enabling clients to succeed."
Julie Gitlin Esther RaiceDesign as an Agent of Digital Transformation at JPMC
June 9, 2021
"It’s important to be transparent so everyone knows what they can see about what they did."
Matteo GrattonCan Data and Ethics Live Together?
October 1, 2021
