Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group
Andy Barraclough
From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme
2024 • DesignOps Summit 2024
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • Advancing Research 2022
Gold
Ivana Ng
Level Up Your Program with ProductOps
2024 • Enterprise Experience 2020
Gold
Louis Rosenfeld
Coffee with Lou
2024 • Rosenfeld Community
Alana Washington
Theme 1: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Advancing Research 2022
Gold
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Raven Veal
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
2021 • Advancing Research 2021
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Katie Johnson
Disrupting generative AI products with just-in-time consumer insights
2024 • Designing with AI 2024
Gold
Rachel Posman
A Closer Look at Team Ops and Product Ops (Two Sides of the DesignOps Coin)
2020 • DesignOps Community
Anna Avrekh
User Research, Design, and Product - A Love Story
2021 • Advancing Research 2021
Gold
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group

More Videos

Sam Proulx

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

December 9, 2021

Michael Land

"Hiring specs for federal designers don’t exist as we expect—jobs are often classified as public affairs or other unrelated titles."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Shipra Kayan

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Ian Swinson

"A workshop helps people map their skills, identify gaps, and make specific goals for career jumps."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Isaac Heyveld

"The chief of staff can be a natural next step from a design program manager or design ops leader of one."

Isaac Heyveld

Expand DesignOps Leadership as a Chief of Staff

September 8, 2022

Amy Evans

"Self-service was a model with the most unknowns but possibly the biggest rewards."

Amy Evans

How to Create Change

September 25, 2024

Kate Koch

"We are stronger when we work together towards a unified goal – that’s our super healing power."

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Dave Gray

"People don’t share their beliefs; you have to search for and understand them to get true buy-in."

Dave Gray

Liminal Thinking: Sense-making for systems in large organizations

May 14, 2015

Matt Duignan

"You have to push against 200,000 years of human evolution to get researchers to create reusable knowledge."

Matt Duignan

Atomizing Research: Trend or Trap

March 30, 2020