Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
Gold
Tuesday, March 31, 2020 • Advancing Research 2020
Share the love for this talk
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
Speakers: Sohit Karol
Link:

Summary

Millions of listeners around the world use Spotify to listen to audio experiences that are personalized to their taste, yet relevant in the broader cultural context. Spotify is a unique product because unlike many other eyes the first app, a majority of Spotify experience is phenomenological – it happens in listeners’ ears, minds and bodies, after they hit “Play”. Why do people form Meaningful Connections™ with some type of audio content, but not all, and how do we ensure that our ML models respect the nuances of what makes listening to music and podcasts enjoyable? This talk will shed light on such topics and leave the audience with ideas, challenges and possible best practices for using Mixed Methods Research in the age of ML to build delightful product experiences.

Key Insights

  • Machine learning algorithms are increasingly central to creating consumer experiences.

  • User researchers play a crucial role in understanding the complexities of human behavior that algorithms must accommodate.

  • Personalization in music involves balancing algorithmic recommendations with editorial insights.

  • User personas are essential for tailoring music experiences to different listener types.

  • Different contexts (like driving or social events) significantly impact how users interact with technology.

  • Skipping songs may not uniformly indicate dissatisfaction; user goals vary by persona.

  • The integration of mixed methods research enhances the development process for machine learning applications.

  • User researchers are increasingly recognized as necessities within machine learning teams.

  • There’s a growing demand for user research, reflecting its importance in tech industries today.

  • Cross-functional collaboration between user researchers and machine learning engineers leads to better user experiences.

Notable Quotes

"We are slowly embarking in a world where algorithms decide many of our consumer experiences."

"There was an old world where DJs decided what songs we listened to; now, it’s machines."

"User research has to be the backbone of machine learning experiences."

"Skips are not simply bad things; they tell us complex stories about user interaction."

"Human behavior is notoriously complex and needs to inform machine learning models."

"The definition of mixed methods research needs to be reconsidered."

"We have moved to a model where customer testing happens early and often in the process."

"There hasn't been a better time to be a user researcher than now."

"The responsibility we have at Spotify is to provide the best listening experience."

"Good predictions lead to great personalized playlists."

More Videos

Jacqui Frey

"Don't try to solve for the system, try to understand the request."

Jacqui Frey

Flow and Superfluidity for Design Orgs

November 7, 2018

Laura Gatewood

"Human connection is a basic and evolutionary need; without it, we struggle to foster resilience."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Johanna Kollmann

"Confirmation bias makes it harder to be open-minded when interpreting research data."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

Bria Alexander

"Please read our code of conduct to ensure a respectful environment."

Bria Alexander

Day 3 Welcome

September 25, 2024

Billy Carlson

"When you explore lots of different ideas, you're going to understand the context better."

Billy Carlson

Ideation tips for Product Managers

December 6, 2022

Catherine Dubut

"Don’t underestimate the power of storytelling in conveying users’ needs to stakeholders."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Kim Holt

"Trust is the foundation of our team's culture and needs to be maintained during changes."

Kim Holt Emma Wylds Pearl Koppenhaver Maisee Xiong

A Salesforce Panel Discussion on Values-Driven DesignOps

September 8, 2022

Adrian Howard

"What's the last bad experience you had with another discipline?"

Adrian Howard

Sturgeon’s Biases

September 25, 2024

Asia Hoe

"Designers can be a little enigmatic and protective of our work."

Asia Hoe

Partnering with Product: A Journey from Junior to Senior Design

November 29, 2023