Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring the Designer Experience
Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Measuring the Designer Experience
Speakers: Kim Fellman Cohen
Link:

Summary

DesignOps teams are increasingly being leveraged to solve ambiguous organizational problems like career development, culture or belonging—they’re cornerstones for any successful team. Creating a measurable strategy for these problems is complex, and it can be hard to prove the value of dedicating full-time resources to maintain this work in the long-run. Based on our learnings at Pinterest, I’ll share tactical approaches you can take to craft programming for this problem space, define what ideal states look like and how you can measure and prove value.

Key Insights

  • Design operations teams can effectively solve complex people and culture problems beyond traditional product focus.

  • Design thinking methods adapted from product work can be used to prototype and iterate on people programs.

  • Collecting real-time qualitative feedback through mixed methods builds empathy and more actionable insights than stale surveys.

  • Defining problems with the right scope and clarity helps generate practical, testable solutions.

  • Including a diverse mix of stakeholders and experts in ideation fosters ownership and buy-in.

  • Establishing measurable objectives linked to concrete numbers enables tracking and proving program impact.

  • Piloting ideas with small groups and embracing failure as learning accelerates refinement of solutions.

  • Regular, transparent reporting to leadership creates trust and supports securing ongoing resources.

  • Balancing long-term strategic bets with quick wins avoids overwhelm and sustains momentum.

  • Even modest improvements in team health metrics can translate into meaningful gains in retention and morale.

Notable Quotes

"People problems find their way to design ops because we’re known problem solvers and people run to us when morale is low."

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

"Design thinking helped us empathize, define problems, co-create ideas, and then test them like products."

"Focus groups build empathy by letting team members share their experiences in real time."

"Our first problem statement was too big, so we refined it to something more doable and actionable."

"If you don’t have the support you need—budget, time, people—your program is at high risk of failure."

"Pilots don’t need to be perfect, they just need enough moving parts to gather useful feedback quickly."

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

"Reporting progress with data and stories opens up opportunities with stakeholders and builds credibility."

"Our team’s improvement wasn’t the final state—we set ambitious goals to be in the 80th to 90th percentile next year."

Ask the Rosenbot
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Maria Taylor
Knowledge is Power: Managing the Lifeblood of the Design Org
2023 • DesignOps Summit 2023
Gold
Shreya Dhawan
Making service tangible: the fastest path to higher performance
2025 • Advancing Service Design 2025
Gold
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Silke Bochat
5 Antifragile Strategies for a DesignOps 2.0
2024 • DesignOps Summit 2024
Gold
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold
Sarah Flamion
Complex Problem? Add Clarity by Combining Research and Systems Thinking
2020 • Advancing Research 2020
Gold
Laura Klein
Human vs. machine: Testing AI’s ability to synthesize and analyze research
2026 • Advancing Research 2026
Conference
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Enterprise UX 2023
Gold
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops
2022 • Advancing Research Community
Ben Reason
Making the system visible: The fastest path to better decisions
2025 • Advancing Service Design 2025
Gold
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold

More Videos

Aaron Stienstra

"The equity executive order calls for a whole-of-government transformation—think about the scale of that."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021

John Donmoyer

"I generated a Tailwind color palette with AI that took seconds, compared to what used to take me some time manually."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Sheryl Cababa

"Pilots and prototyping create evidence to inform decisions, making change more achievable and less risky."

Sheryl Cababa Alexis Oh

Thinking in systems to address climate with Sheryl Cababa

June 12, 2024

Ariel Kennan

"It would have been really easy for the program manager for street homelessness to say no, but instead she gave us access."

Ariel Kennan

Building a Design Culture

June 9, 2017

Ignacio Martinez

"We want to build consultants who can solve problems across a variety of projects and clients."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Dave Hora

"If research findings aren’t connected to action, then you’re just planning and not actually doing strategy."

Dave Hora

Advice for Establishing Research

December 8, 2022

Dr. Jamika D. Burge

"Separating genders in research can perpetuate stereotypes rather than challenge them."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices

September 15, 2022

James Rampton

"Car owners actually keep their cars longer now because they get new features and UI updates over the years remotely."

James Rampton

The Basics of Automotive UX & Why Phones Are a Part of That Future

July 25, 2024

Kristin Wisnewski

"We have about 5,000 new IBMers arriving every month, with high expectations and low tolerance for poor experiences."

Kristin Wisnewski

Measuring What Matters

October 23, 2019