Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring the Designer Experience

Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Measuring the Designer Experience
Speakers: Kim Fellman Cohen
Link:

Summary

DesignOps teams are increasingly being leveraged to solve ambiguous organizational problems like career development, culture or belonging—they’re cornerstones for any successful team. Creating a measurable strategy for these problems is complex, and it can be hard to prove the value of dedicating full-time resources to maintain this work in the long-run. Based on our learnings at Pinterest, I’ll share tactical approaches you can take to craft programming for this problem space, define what ideal states look like and how you can measure and prove value.

Key Insights

  • Design operations teams can effectively solve complex people and culture problems beyond traditional product focus.

  • Design thinking methods adapted from product work can be used to prototype and iterate on people programs.

  • Collecting real-time qualitative feedback through mixed methods builds empathy and more actionable insights than stale surveys.

  • Defining problems with the right scope and clarity helps generate practical, testable solutions.

  • Including a diverse mix of stakeholders and experts in ideation fosters ownership and buy-in.

  • Establishing measurable objectives linked to concrete numbers enables tracking and proving program impact.

  • Piloting ideas with small groups and embracing failure as learning accelerates refinement of solutions.

  • Regular, transparent reporting to leadership creates trust and supports securing ongoing resources.

  • Balancing long-term strategic bets with quick wins avoids overwhelm and sustains momentum.

  • Even modest improvements in team health metrics can translate into meaningful gains in retention and morale.

Notable Quotes

"People problems find their way to design ops because we’re known problem solvers and people run to us when morale is low."

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

"Design thinking helped us empathize, define problems, co-create ideas, and then test them like products."

"Focus groups build empathy by letting team members share their experiences in real time."

"Our first problem statement was too big, so we refined it to something more doable and actionable."

"If you don’t have the support you need—budget, time, people—your program is at high risk of failure."

"Pilots don’t need to be perfect, they just need enough moving parts to gather useful feedback quickly."

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

"Reporting progress with data and stories opens up opportunities with stakeholders and builds credibility."

"Our team’s improvement wasn’t the final state—we set ambitious goals to be in the 80th to 90th percentile next year."

Ask the Rosenbot
Deirdre Hirschtritt
Research is Only as Good as the Relationships You Build
2022 • Civic Design 2022
Gold
Fredrik Matheson
First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.
2016 • Enterprise UX 2016
Gold
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Anna Nguyen
Why Our Voice of the Customer is Better Than Yours
2022 • Advancing Research 2022
Gold
Megan Blocker
Day 2 Theme Panel
2025 • Advancing Research 2025
Gold
Kaitlin Tasker
Fast and Fearless Inclusive Research
2023 • Advancing Research 2023
Gold
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community
Candace Myers
Standardizing Design at Scale
2022 • DesignOps Summit 2022
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Amber Knabl
Empowering innovation: The critical role of inclusive product development in the AI era
2024 • Designing with AI 2024
Gold
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Carl Turner
You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
2023 • Advancing Research 2023
Gold
Séamus Byrne
Aligning Teams with Choreography
2024 • Enterprise Experience 2020
Gold
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
Saara Kamppari-Miller
Theme Three Intro
2023 • DesignOps Summit 2023
Gold
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold

More Videos

Lily Aduana

"You only pay for successfully completed sessions on User Interviews—no upfront cost, no fees for no-shows or cancellations."

Lily Aduana Savannah Hobbs Brittany Rutherford

5 Reasons to Bring Your Recruiting in-House (and How To Do It)

March 12, 2021

Alla Weinberg

"Psychological safety is the foundation; without it you get a culture of transaction and silence."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 9, 2022

Alastair Simpson

"The cargo cult story teaches us that form without understanding is not enough; blindly following process won’t deliver results."

Alastair Simpson

Debunking the Myths of Cross-Disciplinary Collaboration

October 24, 2019

Ali Jeffery

"We need to harness the power of citizens to make real change."

Ali Jeffery Sheri Chudow

How DesignOps Helped Enable Wall Street to Work Remotely

October 22, 2020

Harry Max

"We talked to fifty people and started to see how the world was shaping up in terms of what we needed to do."

Harry Max

Priority Zero: Some Things are More Equal than Others

June 9, 2016

Kristen Honey

"Innovators need a tribe to recharge their batteries because you get no from every direction."

Kristen Honey

"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design

November 18, 2021

Kristen Guth, Ph.D.

"The FOG method helps teams separate facts from fiction and move past hangups toward alignment."

Kristen Guth, Ph.D.

Out of the FOG: A Non-traditional Research Approach to Alignment

March 28, 2023

Justin Entzminger

"We recruited locally and from historically Black colleges and universities to build a diverse and talented innovation team."

Justin Entzminger Terrance Smith Tracy M. Colunga Mai-Ling Garcia

Risk and Reward: How to Diversify the Field of Civic Innovators and Designers

November 17, 2022

Alnie Figueroa

"Think of AI as an additional team member pushing your creative thinking and expanding your idea range."

Alnie Figueroa

The Future of Design Operations: Transforming Our Craft

September 10, 2025