Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Group Activity: A Deep Dive Into Value and Outcomes
Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Group Activity: A Deep Dive Into Value and Outcomes
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • 62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.

  • Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.

  • Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.

  • Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.

  • Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.

  • Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.

  • An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.

  • Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.

  • Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.

  • Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.

Notable Quotes

"When I was asked how I measure success, I said the day I no longer have to convince you."

"62% of people said literally we don't know how to measure the value of design ops yet."

"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."

"People really hated using Harvest to log billable hours, some just put the same hours week after week."

"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."

"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."

"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."

"You can’t have effective teams without happy designers and better designers; they’re interdependent."

"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."

"Our call to action is to co-create these measurement standards together and share back to the community."

Ask the Rosenbot
Katie Hansen
Finding the unknown in the known: Harnessing meta-analysis and literature review
2025 • Advancing Research 2025
Gold
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Shelby Switzer
Making Space for Community Knowledge-sharing in a Distributed World
2021 • Civic Design 2021
Gold
Sarah Auslander
Insights Panel
2022 • Civic Design 2022
Gold
Aras Bilgen
Who does the math: A designer’s journey in building an AI-based tutoring app
2025 • Designing with AI 2025
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2017 • DesignOps Summit 2017
Gold
Peter Levin
Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
2024 • Advancing Research 2024
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Melissa Eggleston
Practical People Skills for Building Trust on Teams and with Partners
2021 • Civic Design 2021
Gold
Uday Gajendar
Day 1 Welcome
2024 • Designing with AI 2024
Gold
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Ali Jeffery
How DesignOps Helped Enable Wall Street to Work Remotely
2020 • DesignOps Summit 2020
Gold
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community
Sean McKay
Whole Product Thinking: Expanding beyond problem and solution space thinking
2024 • Rosenfeld Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold

More Videos

Sam Proulx

"If you have to learn a workaround, you want to learn it once and reuse it again and again."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Ignacio Martinez

"Continuous feedback is anonymous and focused on teammates’ goals to help keep focus on what matters most."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Sarah Kinkade

"Stakeholders saw design as a slow-moving black box — exactly what we were trying to move away from."

Sarah Kinkade Mariana Ortiz-Reyes

Design Management Models in the Face of Transformation

June 8, 2022

Daniel Gloyd

"The Shakers patented clever affordances like chair buttons that let you rock without damaging wooden floors."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Patrick Boehler

"We spend millions on content that nobody wanted and that didn’t actually help people navigate their lives."

Patrick Boehler

Fishing for Real Needs: Reimagining Journalism Needs with AI

June 10, 2025

Andy Barraclough

"Our AI tools help with speed and efficiency, and also help save money by reducing redundant research."

Andy Barraclough Betsy Nelson

From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme

September 23, 2024

Alexandra Schmidt

"Design ethics can impact some harms of new technology but not all."

Alexandra Schmidt

Why Ethics Can't Save Tech

November 18, 2022

Louis Rosenfeld

"Our job as design teams is to teach others what we do, not to feel insecure about sharing."

Louis Rosenfeld

Discussion: What Operations can teach DesignOps

November 6, 2017

Mitchell Bernstein

"When you get stuck, fall back to the loop: observe, reflect, and make. Get out and talk to users."

Mitchell Bernstein

Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape

September 29, 2021