Rosenverse
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • •

    Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • •

    Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • •

    Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • •

    The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • •

    Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • •

    UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • •

    Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • •

    VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • •

    VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • •

    Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Lija Hogan
Three Years Out: Perspectives on the Near-Term Future of User Research
2024 • Advancing Research Community
Liam Thurston
Why Your Design Team Is Quitting, And How To Fix It
2022 • Design at Scale 2022
Gold
John Cutler
The Alignment Trap
2023 • Design in Product 2023
Gold
Maria Skaaden
Continuous Design: One eye on the horizon and the other on the next wave
2018 • DesignOps Summit 2018
Gold
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Reginé Gilbert
Asking the Right Questions: Life, Hope and Moving Forward During the Pandemic
2022 • Design at Scale 2022
Gold
Jules Monza
Use These Words and Count These Things
2024 • DesignOps Summit 2024
Gold
Sara Conklin
Exit Interview: 20 Years of Tech, One Very Big Bet, and a Lot of Heat Pumps
2026 • Rosenfeld Community
Jess Greco
Claiming your power: Practical tools for amplifying your unique voice
2025 • Advancing Research 2025
Gold
Samuel Martin
Co-Design vs Faux-Design: Navigating the Complexities of Sharing Power in Co-Design
2026 • Rosenfeld Community
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Surya Vanka
Unleashing Swarm Creativity to Solve Enterprise Challenges
2021 • Design at Scale 2021
Gold
Melissa Schmidt
How UX Research Hit It Big in Las Vegas
2019 • Enterprise Experience 2019
Gold

More Videos

Rachael Dietkus, LCSW

"What if we moved at the speed of care, support, and hospitality instead of just the speed of trust?"

Rachael Dietkus, LCSW

Trauma-Responsive Design: Reimagining the Future of Design Now

December 10, 2021

Robin Cannon

"Once you start changing components because you didn’t like them, and those changes live only in people’s heads, then the system starts to break down."

Robin Cannon

AI means your design system can't suck anymore

September 9, 2026

Gina Mendolia

"Grandmas provide grounding, resilience, and long-term perspective often through rituals and storytelling."

Gina Mendolia

Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems

December 3, 2024

Sam Proulx

"Testing with real users humanizes the problems and reveals simple fixes like changing one label or color."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

October 2, 2023

Bria Alexander

"Technical difficulties happen, so please use hashtag.deo help within our Slack channel or email for support."

Bria Alexander

Opening Remarks

September 29, 2021

Stephen Pollard

"Organizational culture and values have been essential to ensuring successful delivery."

Stephen Pollard

Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?

November 7, 2017

Cheryl Platz

"Multimodal design adds a layer of orchestration on top of modality-specific designs like voice or graphical UI."

Cheryl Platz

Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing

April 4, 2024

Sam Proulx

"Consistency between control labels and prototype instructions matters a lot, because mismatches can cause big problems for alternative navigation."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

October 1, 2021

Dominique Ward

"Now design ops teams must be fit for purpose. We should meet the needs of the work we have to do."

Dominique Ward

The Most Exciting Time for DesignOps is Now

September 8, 2022