Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Alnie Figueroa
The Future of Design Operations: Transforming Our Craft
2025 • DesignOps Summit 2025
Gold
Alexandra Schmidt
Enterprise UX Playbook
2022 • Enterprise Community
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Denise Jacobs
Interactive Keynote: Social Change by Design
2024 • Enterprise Experience 2020
Gold
Victor Lombardi
Bridging Design and Climate Science
2024 • Climate UX Interest Group
Neema Mahdavi
Operationalizing DesignOps
2018 • DesignOps Summit 2018
Gold
Samuel Proulx
Designing for Disability, Innovating for Everyone
2025 • Advancing Research 2025
Gold
Ted Booth
Discussion
2016 • Enterprise UX 2016
Gold
Husani Oakley
Theme Two Intro
2023 • Enterprise UX 2023
Gold
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold
Jackie Ajoux
Leveling-Up: A Single-Player’s Guide to the DesignOps Team-of-One
2024 • DesignOps Summit 2020
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Dave Malouf
The Future of DesignOps
2024 • DesignOps Summit 2020
Gold

More Videos

Carla Casariego

"Our journey into Wonderland has been wild, wonderful, and requires constant reflection and looking outward for inspiration."

Carla Casariego Sarah Spencer

DesignOps in Wonderland

October 24, 2019

Ariel Kennan

"Protecting my time is something everyone is empathizing with right now."

Ariel Kennan

Civic Design in 2022

January 13, 2022

Kaitlin Tasker

"Women are 70% more likely to walk or use public transit, combining trips that are much harder with snow than driving a car."

Kaitlin Tasker

Fast and Fearless Inclusive Research

March 27, 2023

Sara Asche Anderson

"Being human is the foundation—seeing the person on the other side of the conversation as a human being."

Sara Asche Anderson Jamie Kaspszak

Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy

January 8, 2024

Bria Alexander

"Technical difficulties happen, so please use hashtag.deo help within our Slack channel or email for support."

Bria Alexander

Opening Remarks

September 29, 2021

Cennydd Bowles

"There is no value in outsourcing the thinking of philosophy to AI; doing the thinking yourself is the point."

Cennydd Bowles

Exit Interview #2: Rediscovering the ethical heart of design

November 6, 2025

Jilanna Wilson

"We couldn’t find just one word to describe our third value so we made one up: humbladent—humble and confident together."

Jilanna Wilson

Distributed Design Operations Management

October 23, 2019

Steve Chaparro

"My job was to ask tons of discovery questions to uncover what my clients really needed, not just what they said they wanted."

Steve Chaparro

Bringing Into Alignment Brand, Culture and Space

August 13, 2020

Alnie Figueroa

"Build a program management community of practice so you can formalize partnerships and solve process delivery issues together."

Alnie Figueroa

Teamwork: Strategies for Effective Collaboration with Other Program Management Teams

September 8, 2022