Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring the Designer Experience

Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Measuring the Designer Experience
Speakers: Kim Fellman Cohen
Link:

Summary

DesignOps teams are increasingly being leveraged to solve ambiguous organizational problems like career development, culture or belonging—they’re cornerstones for any successful team. Creating a measurable strategy for these problems is complex, and it can be hard to prove the value of dedicating full-time resources to maintain this work in the long-run. Based on our learnings at Pinterest, I’ll share tactical approaches you can take to craft programming for this problem space, define what ideal states look like and how you can measure and prove value.

Key Insights

  • Design operations teams can effectively solve complex people and culture problems beyond traditional product focus.

  • Design thinking methods adapted from product work can be used to prototype and iterate on people programs.

  • Collecting real-time qualitative feedback through mixed methods builds empathy and more actionable insights than stale surveys.

  • Defining problems with the right scope and clarity helps generate practical, testable solutions.

  • Including a diverse mix of stakeholders and experts in ideation fosters ownership and buy-in.

  • Establishing measurable objectives linked to concrete numbers enables tracking and proving program impact.

  • Piloting ideas with small groups and embracing failure as learning accelerates refinement of solutions.

  • Regular, transparent reporting to leadership creates trust and supports securing ongoing resources.

  • Balancing long-term strategic bets with quick wins avoids overwhelm and sustains momentum.

  • Even modest improvements in team health metrics can translate into meaningful gains in retention and morale.

Notable Quotes

"People problems find their way to design ops because we’re known problem solvers and people run to us when morale is low."

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

"Design thinking helped us empathize, define problems, co-create ideas, and then test them like products."

"Focus groups build empathy by letting team members share their experiences in real time."

"Our first problem statement was too big, so we refined it to something more doable and actionable."

"If you don’t have the support you need—budget, time, people—your program is at high risk of failure."

"Pilots don’t need to be perfect, they just need enough moving parts to gather useful feedback quickly."

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

"Reporting progress with data and stories opens up opportunities with stakeholders and builds credibility."

"Our team’s improvement wasn’t the final state—we set ambitious goals to be in the 80th to 90th percentile next year."

Ask the Rosenbot
Jorge Arango
Exploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
2024 • Rosenfeld Community
Harry Max
Failure Friday #5: Lessons from a SaaS Design Failure
2025 • Rosenfeld Community
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Kaaren Hanson
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold
Dan Saffer
Why AI projects fail (and what we can do about it)
2025 • Rosenfeld Community
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Mansi Gupta
Drawing from Feminist Practice to Make Inclusive Design Operational
2022 • DesignOps Summit 2022
Gold
Peter Van Dijck
Designing AI-first products on top of a rapidly evolving technology
2025 • Designing with AI 2025
Gold
Melinda Belcher
Bridging the Gap: Making the Most of the Differences Between Agency and Enterprise
2024 • Enterprise Experience 2020
Gold
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold
JD Buckley
Communicating the ROI of UX within a large enterprise and out on the streets
2018 • Enterprise Experience 2018
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Dave Gray
Group Activity: Making Sense of DesignOps
2017 • DesignOps Summit 2017
Gold

More Videos

Bria Alexander

"This day is focused on me, my job and my specific day-to-day challenges, not on some invisible finish line or senior title."

Bria Alexander

Theme Two Intro

October 3, 2023

Ariba Jahan

"Check-outs and reflections normalized pausing and being honest about what we don’t know."

Ariba Jahan

Team Resiliency Through a Pandemic

January 8, 2024

Cornelius Rachieru

"While the majority of design happens in the lower half of this scale, we create gaps at the higher, systemic levels that we must address."

Cornelius Rachieru

Handling Complexity: Framing a Scale of Design

June 9, 2021

Megan Clegg

"Compliance is not enough; we need to go beyond minimum legal requirements for true accessibility."

Megan Clegg Michael Haggerty-Villa Alexis Morin

Space for Everyone: Reframing Accessibility Through a Wider Lens

June 10, 2021

Saara Kamppari-Miller

"Publishing a component library means anyone can update titles or roles, and it updates everywhere at once."

Saara Kamppari-Miller

Cartography for Design Communities

September 10, 2025

Kara Kane

"The UK Government Digital Service launched 10 years ago, kicking off a new era in digital public service."

Kara Kane

Theme One Intro

November 16, 2022

Natalia Radywyl

"The system had catastrophically failed to live up to expert expectations and was underprepared for future challenges."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Nancy Douyon

"If you want to scale, incorporate global UX research from day one and test your assumptions broadly."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Peter Van Dijck

"Co-creation between users and technology determines if this AI evolves to be useful or harmful."

Peter Van Dijck

Building the Rosenbot

June 4, 2024