Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Group Activity: A Deep Dive Into Value and Outcomes

Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Group Activity: A Deep Dive Into Value and Outcomes
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • 62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.

  • Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.

  • Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.

  • Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.

  • Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.

  • Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.

  • An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.

  • Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.

  • Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.

  • Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.

Notable Quotes

"When I was asked how I measure success, I said the day I no longer have to convince you."

"62% of people said literally we don't know how to measure the value of design ops yet."

"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."

"People really hated using Harvest to log billable hours, some just put the same hours week after week."

"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."

"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."

"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."

"You can’t have effective teams without happy designers and better designers; they’re interdependent."

"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."

"Our call to action is to co-create these measurement standards together and share back to the community."

Ask the Rosenbot
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Jeff Gothelf
Innovation Studios: the Engines of Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Scott Stephens
The Next Generation in DesignOps Toolsets
2022 • DesignOps Community
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold
You’ve got Gold! A Rosenverse demo with Lou Rosenfeld
2026 • Rosenfeld Community
George Abraham
Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
2021 • DesignOps Summit 2021
Gold
Dave Malouf
The Past, Present, and Future of DesignOps: a 2-part DesignOps Community Call (Part 2)
2022 • DesignOps Community
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life
2022 • Enterprise Community
Terry Buckman
Wargaming (An Introduction)
2023 • Enterprise Community
Shivanjali M.
From Fragmented to Fluent: The Linguistic Approach to Research Knowledge
2026 • Rosenfeld Community
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community
Dr. Karl Jeffries
The Science of Creativity for DesignOps
2024 • DesignOps Summit 2020
Gold
Raven Veal
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
2021 • Advancing Research 2021
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold

More Videos

Kate Towsey

"Research’s role may shift to orchestrators of AI-synthesized insights and gap analyses rather than just primary data collectors."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Jennifer Kong

"The unpredictable black box nature of LLMs means we had to zoom in on small problems first before seeing the bigger picture."

Jennifer Kong

Journeying toward AI-assisted documentation in healthcare

June 5, 2024

Kevin M. Hoffman

"Thou art community, connection, and meaning – the product is not just code or design, it is a shared experience between humans and dogs."

Kevin M. Hoffman

Theme 2: Enterprise Team Journey

June 3, 2019

Amy Marquez

"I never want to walk into a review with my stakeholders at the SVP level and see something for the first time."

Amy Marquez

INVEST: Discussion

June 15, 2018

Gretchen Anderson

"I see designers fall back on being the defender of the user like a union boss, but that’s not your only responsibility."

Gretchen Anderson

Scaling the Human Center

June 8, 2017

April Reagan

"AI can be a great partner to humans if trained with fair and complete data, but we must be careful not to ship biased systems."

April Reagan

Look, Think, Act: The Futures-Smart Design Organization

October 1, 2021

Dante Guintu

"The pandemic flipped the equation, and IBM became the place that design talent left."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Jaime Creixems

"Design system is basically an agreement that helps create a sense of consistency and familiarity in all the UIs that you create."

Jaime Creixems

Best Practices when Creating and Maintaining a Design System

June 7, 2023

Billy Carlson

"Wireframes should not really be considered prototypes or high polished scale models of the thing."

Billy Carlson

Principles of Team Wireframing

October 2, 2023