Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Speakers: John Calhoun and Rachel Posman
Link:

Summary

Measuring DesignOps value is surprisingly complicated. Many practitioners would agree with the sentiment that measuring their impact feels aspirational at best, and theoretical at worst. Anecdotal evidence and praise from partners (“I don't know what we’d do without you!”) is nice, but doesn’t add up to proof that DesignOps is a worthy return on investment. In this talk, we’ll share two novel approaches to measuring DesignOps success from our upcoming book, The Design Conductors: Your Essential Guide to Design Operations. These methods–the “Jobs to Be Done” and “HEROES” frameworks–can be used to uncover and define measures of value that more accurately capture the impact DesignOps (and design) has on a business and its stakeholders. We will also share some tested rubrics that DesignOps can use to prioritize and implement these new measures.

Key Insights

  • Measuring design ops value is crucial yet complex.

  • Many design ops teams lack clearly defined metrics and outcomes.

  • Traditional business frameworks are inadequate for measuring design ops.

  • The Jobs to Be Done framework helps to uncover customer needs in design ops.

  • The Heroes framework categorizes impacts of design ops into six areas: health, effectiveness, readiness, outcomes, ecosystem, and sentiment.

  • Design ops should focus on making their work visible to ensure organizational investment.

  • Tailored metrics can enhance the understanding and appreciation of design ops.

  • Each framework offers a unique approach to measuring design ops effectiveness.

  • Organizational context should guide measure prioritization.

  • Fostering a culture of measurement empowers design ops teams.

Notable Quotes

"Measuring wrong can cost you a half billion dollars."

"We need to broaden our shared definition of design ops value."

"Design and design ops value are often defined by traditional frameworks, but applying these is like trying to fit a star in a box."

"These frameworks are just not good enough for design ops."

"If designers can use the Jobs to Be Done framework, design ops practitioners can too."

"Healthy teams are the foundation of a healthy organization."

"The Heroes framework acts more like a questionnaire rather than a step-by-step guide."

"Design ops can make a significant difference by tracking specific health metrics."

"Measuring sentiment is crucial to reflect the value placed on design."

"Doing good work is what's most important."

Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Peter Levin
Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
2024 • Advancing Research 2024
Gold
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire
2022 • Civic Design Community
Billy Carlson
Pro-level UI Tips for Beginners
2022 • DesignOps Summit 2022
Gold
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Sean McKay
Whole Product Thinking: Expanding beyond problem and solution space thinking
2024 • Rosenfeld Community
Jorge Arango
The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)
2024 • Rosenfeld Community
Joi Freeman
A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
2020 • Advancing Research 2020
Gold
Taylor Jennings
Repository Retrospective: Learnings from Introducing a Central Place for UX Research
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • Designing with AI 2025
Conference
Anat Fintzi
Delivering at Scale: Making Traction with Resistant Partners
2022 • Design at Scale 2022
Gold
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
Jamika Burge
Embracing change: Navigating shifting landscapes with compassion and agency
2025 • Advancing Research 2025
Gold
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold

More Videos

April Reagan

"Thank you for those of you who have just hung in to the very last talk today."

April Reagan

Look, Think, Act: The Futures-Smart Design Organization

October 1, 2021

Dane DeSutter

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

Dane DeSutter

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not

March 26, 2024

Tatyana Mamut

"It's not that people are wrong; it's that they all have different perspectives and partial knowledge."

Tatyana Mamut

Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart

June 3, 2019

Ana Maria Montero Barrantes

"Let’s fix the UX together by amplifying each other’s voices."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Ned Gartside

"The future of digital job roles will increasingly focus on combining accessibility with sustainability principles."

Ned Gartside Mike Gifford Zoe Lopez-Latorre Tzviya Siegman

Navigating accessibility and climate

April 17, 2024

Sam Proulx

"Transitioning to mobile-first accessibility can foster confidence among users with disabilities when interacting online."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

September 8, 2022

Melinda Belcher

"You want partnership, you want someone who thinks in terms of business and helps you achieve your business results."

Melinda Belcher

Insider preview of Enterprise Experience 2020

May 28, 2020

Christian Bason

"Let's think about how to empathize with not just people but all living beings."

Christian Bason

Expand—Rethinking Design for Public Challenges

September 14, 2022

Ren Pope

"Knowledge comes in many forms and shapes; designing a product to meet various needs is challenging."

Ren Pope

Building Experiences for Knowledge Systems

June 6, 2023