Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Speakers: John Calhoun and Rachel Posman
Link:

Summary

Measuring DesignOps value is surprisingly complicated. Many practitioners would agree with the sentiment that measuring their impact feels aspirational at best, and theoretical at worst. Anecdotal evidence and praise from partners (“I don't know what we’d do without you!”) is nice, but doesn’t add up to proof that DesignOps is a worthy return on investment. In this talk, we’ll share two novel approaches to measuring DesignOps success from our upcoming book, The Design Conductors: Your Essential Guide to Design Operations. These methods–the “Jobs to Be Done” and “HEROES” frameworks–can be used to uncover and define measures of value that more accurately capture the impact DesignOps (and design) has on a business and its stakeholders. We will also share some tested rubrics that DesignOps can use to prioritize and implement these new measures.

Key Insights

  • Measuring design ops value is crucial yet complex.

  • Many design ops teams lack clearly defined metrics and outcomes.

  • Traditional business frameworks are inadequate for measuring design ops.

  • The Jobs to Be Done framework helps to uncover customer needs in design ops.

  • The Heroes framework categorizes impacts of design ops into six areas: health, effectiveness, readiness, outcomes, ecosystem, and sentiment.

  • Design ops should focus on making their work visible to ensure organizational investment.

  • Tailored metrics can enhance the understanding and appreciation of design ops.

  • Each framework offers a unique approach to measuring design ops effectiveness.

  • Organizational context should guide measure prioritization.

  • Fostering a culture of measurement empowers design ops teams.

Notable Quotes

"Measuring wrong can cost you a half billion dollars."

"We need to broaden our shared definition of design ops value."

"Design and design ops value are often defined by traditional frameworks, but applying these is like trying to fit a star in a box."

"These frameworks are just not good enough for design ops."

"If designers can use the Jobs to Be Done framework, design ops practitioners can too."

"Healthy teams are the foundation of a healthy organization."

"The Heroes framework acts more like a questionnaire rather than a step-by-step guide."

"Design ops can make a significant difference by tracking specific health metrics."

"Measuring sentiment is crucial to reflect the value placed on design."

"Doing good work is what's most important."

Lisanne Norman
Why I Left Research
2023 • Advancing Research 2023
Gold
Molly Fargotstein
Multipurpose Communication & UX Research Marketing
2019 • DesignOps Community
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
Amy Paris
Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities
2021 • Civic Design 2021
Gold
Sarah Barrett
The "How" of Enterprise Information Architecture
2023 • Enterprise UX 2023
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Josh Clark
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
2025 • Rosenfeld Community
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Conference
Bud Caddell
Theme 2 Intro
2021 • DesignOps Summit 2021
Gold
Frances Yllana
Theme 2 Intro
2024 • DesignOps Summit 2024
Gold
Erin May
Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
2022 • Advancing Research 2022
Gold
Nancy Douyon
We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
2018 • Enterprise Experience 2018
Gold
Gillian Salerno-Rebic
Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation
2025 • Designing with AI 2025
Conference

More Videos

Noz Urbina

"How can we put a chatbot in the product instead of only at the end of the process?"

Noz Urbina

Rapid AI-powered UX (RAUX): A framework for empowering human designers

May 1, 2025

Jim Kalbach

"There are guidelines that we rely on to help us stay together."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

June 4, 2019

Holly Cole

"I want to talk to you about are you really doing user-centered teamwork when you're thinking about growing a team."

Holly Cole

Understanding Experiences: When you have to do more than work

November 8, 2018

Jack Behar

"We're not doing just a simple flip of our boards, this is actually contained code."

Jack Behar

How to Build Prototypes that Behave like an End-Product

December 6, 2022

Bria Alexander

"Welcome to day two of Design Ops 2023. If you can believe it, we are halfway through our programming today."

Bria Alexander

Opening Remarks

October 3, 2023

Erika Flowers

"Focus on destination rather than just vehicle; what are we trying to achieve with AI?"

Erika Flowers

AI-Readiness: Preparing NASA for a Data-Driven, Agile Future

June 10, 2025

Kristin Skinner

"Data is not just numbers; it tells us the story of student learning."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Jim Kalbach

"How can a group of people come together and spontaneously create something that is legendary?"

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

November 6, 2017

Surya Vanka

"Think in systems to scale creative initiatives effectively."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021