Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Steve Sanderson
Discussion
2015 • Enterprise UX 2015
Gold
Tricia Wang
The most popular design thinking strategy is BS
2022 • Enterprise Community
Product and Design at Bloomberg: A 15-year Evolution
2022 • Design in Product 2022
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Jeff Gothelf
Innovation Studios: the Engines of Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Community
John Paul de Guzman
10k Screens Later: How We Became a Data-Driven Design Organization
2024 • DesignOps Summit 2024
Gold
Amy Parness
Scaling Sustainability: Complementary strategies that drive long-term success
2025 • Climate UX Interest Group
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group
Patrick Boehler
Fishing for Real Needs: Reimagining Journalism Needs with AI
2025 • Designing with AI 2025
Gold
Lada Gorlenko
Theme 3: Introduction
2021 • Design at Scale 2021
Gold
Jenny Price
From Tradition to Transformation: Unlocking Startup Agility in a Legacy Enterprise
2025 • DesignOps Summit 2025
Conference
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Dr. Jamika D. Burge
Bridge Building across Research Disciplines
2021 • Advancing Research Community
World Usability Day Panel Discussion
2022 • DesignOps Community

More Videos

Randolph Duke II

"I hadn’t realized that we were both going to need that advice."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020

Corey Nelson

"Build relationships before you need them. You can’t create them when the house is on fire."

Corey Nelson Amy Santee

Layoffs

November 15, 2022

Landon Barnes

"Statistical significance tells you if a change is likely not random, but it does not tell you if the change matters to your business."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Amy Bucher

"Logic models are boring but powerful tools to align expectations that behavior change is complex and not immediate."

Amy Bucher

Harnessing behavioral science to uncover deeper truths

March 12, 2025

David Sternberg

"Human behavior is anything but linear, rational, or predictable."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025

Deanna Smith

"Not everything that is faced can be changed, but nothing can be changed until it is faced."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Jennifer Strickland

"Hiring for lived experience, not just academic credentials, changes the game."

Jennifer Strickland

Adopting a "Design By" Method

December 9, 2021

Rachel Posman

"Our team Ops Charter is about amplifying and celebrating the work and impact of design and design Ops."

Rachel Posman John Calhoun

A Closer Look at Team Ops and Product Ops (Two Sides of the DesignOps Coin)

November 19, 2020

Gina Mendolia

"Grandmas provide grounding, resilience, and long-term perspective often through rituals and storytelling."

Gina Mendolia

Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems

December 3, 2024