Summary
Measuring DesignOps value is surprisingly complicated. Many practitioners would agree with the sentiment that measuring their impact feels aspirational at best, and theoretical at worst. Anecdotal evidence and praise from partners (“I don't know what we’d do without you!”) is nice, but doesn’t add up to proof that DesignOps is a worthy return on investment. In this talk, we’ll share two novel approaches to measuring DesignOps success from our upcoming book, The Design Conductors: Your Essential Guide to Design Operations. These methods–the “Jobs to Be Done” and “HEROES” frameworks–can be used to uncover and define measures of value that more accurately capture the impact DesignOps (and design) has on a business and its stakeholders. We will also share some tested rubrics that DesignOps can use to prioritize and implement these new measures.
Key Insights
-
•
Traditional business metrics are often too narrow to capture the full value of design operations.
-
•
Only about 50% of design ops practitioners have clearly defined metrics; just 41% measure design ops impact.
-
•
The Jobs to Be Done framework can be adapted to design ops to define measurable outcomes linked to stakeholder needs.
-
•
The Hero's Framework categorizes design ops impact into six areas: Health, Effectiveness, Readiness, Outcomes, Ecosystem, and Sentiment.
-
•
Design ops should measure metrics tailored to their organization's mission, operating model, and current workstreams for best results.
-
•
Expansion and contraction business phases affect which design ops metrics and outcomes teams should prioritize.
-
•
Outcome-driven prioritization factors (success, progress, problem) help ensure metrics focus on improving change, not just status quo.
-
•
Visibility of design ops work is critical to securing investment and recognition from leadership, as noted by Jared Spool and Sarah Walker Bocher.
-
•
Measurement frameworks should help design ops move away from measuring all things to measuring what truly matters for impact and sustainability.
-
•
The example of a Gen AI Summer Camp showed how design ops used readiness metrics and qualitative feedback to demonstrate tangible value.
Notable Quotes
"Measuring wrong can cost you half a billion dollars, but also what you measure and how you measure matters a lot."
"Design ops isn’t rocket science, but between us it might actually be harder."
"Design ops is a flexible and adaptable practice, meaning our goals and outcomes are usually more fluid than stable."
"Applying traditional frameworks to design ops is like trying to fit a star in a box."
"Design teams don’t want a design ops drill, they need a quarter inch hole that requires a little bit of program management."
"Healthy teams are the foundation of a healthy organization."
"Every hiccup in a process and every outdated protocol accumulates a toll on the team as well as financial costs."
"Visibility is the most vital thing for UX leaders to be focused on."
"Endlessly justifying yourself rarely changes others’ opinions. It positions design ops as up for debate."
"We choose to measure design ops value not because it is easy, but because it is hard."
Or choose a question:
More Videos
"How might we statements are small but mighty questions that let us reframe insights into opportunity areas."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022
"On desktop, users pick varying assistive tools, making replicability of experience difficult; on mobile, the assistive tech is tightly integrated and versioned."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"It's okay. I just wish it were a little bit jazzier and sexier."
Dan WillisEnterprise Storytelling Sessions
May 13, 2015
"Single sign-on was going to be really important because I didn’t want any barrier entry for people."
Michael PolivkaScaling Design through Relationship Maps
November 7, 2017
"AI-powered enterprise tools sit on top of the classic IA infrastructure; without it, AI can’t scale effectively."
Karen McGrane Jeff EatonAI for Information Architects: Are the robots coming for our jobs?
November 21, 2024
"At DTA, distributed teams and lack of local diversity meant everyone was out in the field a lot to get diverse input."
Leisa ReicheltOpening Keynote: Operating in Context
November 7, 2018
"Trust takes time, hard work, and consistency to build, especially in times of change when time is a luxury we don't have."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"Say it until someone says it better back to you."
Jacqui Frey Alison RandSetting the Table for Dynamic Change
October 24, 2019
"Talking about UX ROI as reducing failure is like opening a new restaurant and saying please come because we won’t make you sick."
How to Identify and Increase your "Experience Quotient"
June 15, 2018
Latest Books All books
Dig deeper with the Rosenbot
How does the EU AI Act define and classify risk levels in AI applications?
How can product designers apply video game motivators like mastery and companionship to non-game products?
What tools or formats work best to align diverse teams with different digital literacy levels on a market launch process?