Rosenverse
Measuring the Designer Experience

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring the Designer Experience

Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Measuring the Designer Experience
Speakers: Kim Fellman Cohen
Link:

Summary

DesignOps teams are increasingly being leveraged to solve ambiguous organizational problems like career development, culture or belonging—they’re cornerstones for any successful team. Creating a measurable strategy for these problems is complex, and it can be hard to prove the value of dedicating full-time resources to maintain this work in the long-run. Based on our learnings at Pinterest, I’ll share tactical approaches you can take to craft programming for this problem space, define what ideal states look like and how you can measure and prove value.

Key Insights

  • Design operations teams can effectively solve complex people and culture problems beyond traditional product focus.

  • Design thinking methods adapted from product work can be used to prototype and iterate on people programs.

  • Collecting real-time qualitative feedback through mixed methods builds empathy and more actionable insights than stale surveys.

  • Defining problems with the right scope and clarity helps generate practical, testable solutions.

  • Including a diverse mix of stakeholders and experts in ideation fosters ownership and buy-in.

  • Establishing measurable objectives linked to concrete numbers enables tracking and proving program impact.

  • Piloting ideas with small groups and embracing failure as learning accelerates refinement of solutions.

  • Regular, transparent reporting to leadership creates trust and supports securing ongoing resources.

  • Balancing long-term strategic bets with quick wins avoids overwhelm and sustains momentum.

  • Even modest improvements in team health metrics can translate into meaningful gains in retention and morale.

Notable Quotes

"People problems find their way to design ops because we’re known problem solvers and people run to us when morale is low."

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

"Design thinking helped us empathize, define problems, co-create ideas, and then test them like products."

"Focus groups build empathy by letting team members share their experiences in real time."

"Our first problem statement was too big, so we refined it to something more doable and actionable."

"If you don’t have the support you need—budget, time, people—your program is at high risk of failure."

"Pilots don’t need to be perfect, they just need enough moving parts to gather useful feedback quickly."

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

"Reporting progress with data and stories opens up opportunities with stakeholders and builds credibility."

"Our team’s improvement wasn’t the final state—we set ambitious goals to be in the 80th to 90th percentile next year."

Ask the Rosenbot
How to Identify and Increase your "Experience Quotient"
2018 • Enterprise Experience 2018
Gold
Sarah Gallimore
Inspire Progress with Artifacts from the Future
2022 • Civic Design 2022
Gold
Adam Thomas
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
2022 • Design in Product 2022
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Erika Flowers
The Handoff is Dead: Design-Led Engineering with AI Agents
2026 • Rosenfeld Community
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Amahra Spence
Designing for Liberation, Rehearsing Freedom
2022 • Civic Design 2022
Gold
Jemma Ahmed
Theme Panel
2025 • Advancing Research 2025
Gold
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Enterprise Community
Dan Willis
Enterprise Storytelling Sessions
2017 • Enterprise Experience 2017
Gold
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Kaitlin Tasker
Fast and Fearless Inclusive Research
2023 • Advancing Research 2023
Gold
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Gold
Kurt McCulloch
Faster alone, further together: Rebuilding collaboration in the age of AI research
2026 • Advancing Research 2026
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold

More Videos

Uday Gajendar

"Cheryl will connect design thinking approaches to systems thinking, laying down foundational concepts."

Uday Gajendar

Theme One Intro

June 6, 2023

Dan Donald

"The value of a design system looks different depending on if you’re a developer, designer, or stakeholder."

Dan Donald

Design Systems as a Vehicle for Systemic Change

June 1, 2023

Feleesha Sterling

"Rapid research programs enable designers to submit research questions and feel empowered to participate actively in the research process."

Feleesha Sterling

Building a Rapid Research Program

May 18, 2023

Jeff Ephraim Bander

"Only 38% of people actually looked at the company review information, even though it was crucial."

Jeff Ephraim Bander Ariane Rahn Philipp Reiter

Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research

March 11, 2022

Sam Proulx

"The most important thing you can do is listen and watch and put assumptions aside about what is easy or hard."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Jemma Ahmed

"Each stage of growth brings different challenges for UX to overcome."

Jemma Ahmed

Theme 2 Intro

January 8, 2024

Raven Veal

"An AI algorithm that didn’t explicitly consider race still produced racial disparities by using healthcare costs as a proxy."

Raven Veal

Dark Metrics: Illuminating the Negative Impact of Digital Health Design

March 12, 2021

Nicole Wright

"Most people have read-only access to summaries, while power users have broader access to dive deeper into research data."

Nicole Wright Ned Dwyer

Democratizing Research at HoneyBook

March 9, 2022

Jim Kalbach

"Experience mapping brought a new understanding that helped us draw former extremists into peace efforts."

Jim Kalbach

Peace is waged with sticky notes: Mapping Real-World Experiences

June 14, 2018