Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
Dalia El-Shimy
So You've Got a Seat at the Table. Now What?
2020 • Advancing Research 2020
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Design in Product 2023
Gold
DesignOps and The Great Talent War of 2021
2021 • DesignOps Community
Jeff Sussna
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Kevin Bethune
Gatekeepers and Servant Leadership
2020 • DesignOps Community
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Renee Reid
Becoming a ResearchH.E.R (Highly Enterprise Ready)
2019 • Enterprise Experience 2019
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Conference
Benjamin Real
Maturity Models: A Core Tool for Creating a DesignOps Strategy
2021 • DesignOps Summit 2021
Gold
Jessica Norris
ADHD: A DesignOps Superpower
2022 • DesignOps Summit 2022
Gold
Lena Shenkarenko
Collaborative Wireframing for Creating Team Alignment and Shipping Better Products
2020 • DesignOps Summit 2020
Gold
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold

More Videos

Lily Aduana

"Professional testers are very crafty; one even changed her name repeatedly to get recruited multiple times."

Lily Aduana Savannah Hobbs Brittany Rutherford

5 Reasons to Bring Your Recruiting in-House (and How To Do It)

March 12, 2021

Alla Weinberg

"Psychological safety is the foundation; without it you get a culture of transaction and silence."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Alastair Simpson

"You have to know when to raise the bandwidth. If you see 10 plus people commenting in Slack, consider jumping on a video call."

Alastair Simpson

Debunking the Myths of Cross-Disciplinary Collaboration

October 24, 2019

Ali Jeffery

"Green spaces are not luxuries—they're necessities for urban life."

Ali Jeffery Sheri Chudow

How DesignOps Helped Enable Wall Street to Work Remotely

October 22, 2020

Harry Max

"We talked to fifty people and started to see how the world was shaping up in terms of what we needed to do."

Harry Max

Priority Zero: Some Things are More Equal than Others

June 9, 2016

Kristen Honey

"It’s easier to create a better system that makes your old system obsolete than to change what is baked in."

Kristen Honey

"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design

November 18, 2021

Kristen Guth, Ph.D.

"Research is the most analytical form of information processing because it involves active knowledge generation."

Kristen Guth, Ph.D.

Out of the FOG: A Non-traditional Research Approach to Alignment

March 28, 2023

Justin Entzminger

"City Hall is often risk-averse, and professionals of color face extra penalties for taking risks in their careers."

Justin Entzminger Terrance Smith Tracy M. Colunga Mai-Ling Garcia

Risk and Reward: How to Diversify the Field of Civic Innovators and Designers

November 17, 2022

Alnie Figueroa

"AI is here to stay, challenging our norms and shaping our future."

Alnie Figueroa

The Future of Design Operations: Transforming Our Craft

September 10, 2025