Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring the Designer Experience
Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Measuring the Designer Experience
Speakers: Kim Fellman Cohen
Link:

Summary

DesignOps teams are increasingly being leveraged to solve ambiguous organizational problems like career development, culture or belonging—they’re cornerstones for any successful team. Creating a measurable strategy for these problems is complex, and it can be hard to prove the value of dedicating full-time resources to maintain this work in the long-run. Based on our learnings at Pinterest, I’ll share tactical approaches you can take to craft programming for this problem space, define what ideal states look like and how you can measure and prove value.

Key Insights

  • Design operations teams can effectively solve complex people and culture problems beyond traditional product focus.

  • Design thinking methods adapted from product work can be used to prototype and iterate on people programs.

  • Collecting real-time qualitative feedback through mixed methods builds empathy and more actionable insights than stale surveys.

  • Defining problems with the right scope and clarity helps generate practical, testable solutions.

  • Including a diverse mix of stakeholders and experts in ideation fosters ownership and buy-in.

  • Establishing measurable objectives linked to concrete numbers enables tracking and proving program impact.

  • Piloting ideas with small groups and embracing failure as learning accelerates refinement of solutions.

  • Regular, transparent reporting to leadership creates trust and supports securing ongoing resources.

  • Balancing long-term strategic bets with quick wins avoids overwhelm and sustains momentum.

  • Even modest improvements in team health metrics can translate into meaningful gains in retention and morale.

Notable Quotes

"People problems find their way to design ops because we’re known problem solvers and people run to us when morale is low."

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

"Design thinking helped us empathize, define problems, co-create ideas, and then test them like products."

"Focus groups build empathy by letting team members share their experiences in real time."

"Our first problem statement was too big, so we refined it to something more doable and actionable."

"If you don’t have the support you need—budget, time, people—your program is at high risk of failure."

"Pilots don’t need to be perfect, they just need enough moving parts to gather useful feedback quickly."

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

"Reporting progress with data and stories opens up opportunities with stakeholders and builds credibility."

"Our team’s improvement wasn’t the final state—we set ambitious goals to be in the 80th to 90th percentile next year."

Sarah Fathallah
Lessening the Research Burden on Vulnerable Communities
2020 • Advancing Research 2020
Gold
Dawn Ressel
Full-Stack User Experiences: A Marriage of Design and Technology
2016 • Enterprise UX 2016
Gold
Alan Williams
Designing essential financial services for those in need
2022 • Civic Design Community
Michael Polivka
Scaling Design through Relationship Maps
2017 • DesignOps Summit 2017
Gold
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
Mac Smith
Measuring Up: Using Product Research for Organizational Impact
2021 • Advancing Research 2021
Gold
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group
Yulya Besplemennova
[Demo] Stress-testing GenAI in user research synthesis
2024 • Designing with AI 2024
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Jayne Engle
Civic Design for the Next Seven Generations—A Discussion on Sacred Civics
2022 • Civic Design Community
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Sofia Quintero
Beyond Tools: The Messy Business of Implementing Research Repositories
2022 • Advancing Research 2022
Gold
Kelly Goto
Emotion Economy: Ethnography as Corporate Strategy
2015 • Enterprise UX 2015
Gold

More Videos

Randolph Duke II

"Laura let out a sigh of relief and said, I don’t think I could ever recover the way that you did."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020

Corey Nelson

"Don’t force yourself into a job you know isn’t right just because you’re unemployed."

Corey Nelson Amy Santee

Layoffs

November 15, 2022

Landon Barnes

"When executives start questioning your research details, that’s a good sign they’re engaged and trusting the process."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Amy Bucher

"Most of my career has been in health, and it’s really important that we don’t just get people to do something once, but sustain a new behavior."

Amy Bucher

Harnessing behavioral science to uncover deeper truths

March 12, 2025

David Sternberg

"The interface you’ve designed is like a landscape shaping the flow of user behavior as water flows through a stream."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025

Deanna Smith

"Piloting your ideas before committing helps prevent disruption and saves energy in the long run."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Jennifer Strickland

"The absence of empathy and understanding is causing much of the pain in design."

Jennifer Strickland

Adopting a "Design By" Method

December 9, 2021

Rachel Posman

"Our team Ops Charter is about amplifying and celebrating the work and impact of design and design Ops."

Rachel Posman John Calhoun

A Closer Look at Team Ops and Product Ops (Two Sides of the DesignOps Coin)

November 19, 2020

Gina Mendolia

"Mirroring content by repeating back what people say helps them understand their own ideas better."

Gina Mendolia

Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems

December 3, 2024