Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Group Activity: A Deep Dive Into Value and Outcomes
Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Group Activity: A Deep Dive Into Value and Outcomes
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • 62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.

  • Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.

  • Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.

  • Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.

  • Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.

  • Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.

  • An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.

  • Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.

  • Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.

  • Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.

Notable Quotes

"When I was asked how I measure success, I said the day I no longer have to convince you."

"62% of people said literally we don't know how to measure the value of design ops yet."

"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."

"People really hated using Harvest to log billable hours, some just put the same hours week after week."

"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."

"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."

"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."

"You can’t have effective teams without happy designers and better designers; they’re interdependent."

"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."

"Our call to action is to co-create these measurement standards together and share back to the community."

Ask the Rosenbot
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Gillian Salerno-Rebic
Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation
2025 • Designing with AI 2025
Gold
Smitha Papolu
Theme 3 Discussion
2019 • Enterprise Experience 2019
Gold
Michael Polivka
Scaling Design through Relationship Maps
2017 • DesignOps Summit 2017
Gold
Bria Alexander
Day 3 Welcome
2024 • DesignOps Summit 2024
Gold
Dante Guintu
How to Crush the Talent Crunch
2022 • DesignOps Summit 2022
Gold
Nicole Wright
Democratizing Research at HoneyBook
2022 • Advancing Research 2022
Gold
Megan Campos
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
2021 • Advancing Research 2021
Gold
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Deanna Zandt
The Unspoken Complexity of “Self-Care” with Deanna Zandt
2022 • Civic Design Community
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Peter Merholz
The Mysterious Case of the Missing UX Career Path
2022 • DesignOps Community
Bud Caddell
Theme 2 Intro
2021 • DesignOps Summit 2021
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold

More Videos

Scott Plewes

"Math by itself can be misleading and full of biases, but combined with humanities research, it can be very powerful."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023

Alison Rand

"People often go along with the outcome if they feel they were part of the process."

Alison Rand Sarah Brooks

Scaling Impact with Service Design

March 25, 2021

Rachael Dietkus, LCSW

"The power of a bold idea uttered publicly in defiance of dominant opinion cannot be easily measured."

Rachael Dietkus, LCSW

The power to heal and harm

March 13, 2025

Sheryl Cababa

"Freedom dreaming is dreaming about a system that is free from today's oppression."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023

Renee Bouwens

"Product managers are often prioritization focused, so they can bias themselves in research decisions."

Renee Bouwens

Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products

December 15, 2023

JP Allen

"We took a little bit more of an editorial approach and kind of trimmed down the tools to keep it legible and usable."

JP Allen Holly Holden

Navigating the UX Tools Landscape

October 1, 2021

Bria Alexander

"If you have a question for a speaker, put it in the thread for their talk, not in the general chat."

Bria Alexander

Opening Remarks

November 18, 2022

Llewyn Paine

"User recordings are your most valuable asset but have become riskier due to biometric privacy laws."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Ricardo Martins

"Cluster analysis is very useful if you want to avoid a one-size-fits-all approach to product or service design."

Ricardo Martins

Unlocking the power of advanced quantitative methods

March 12, 2025