Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Group Activity: A Deep Dive Into Value and Outcomes
Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Group Activity: A Deep Dive Into Value and Outcomes
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • 62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.

  • Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.

  • Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.

  • Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.

  • Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.

  • Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.

  • An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.

  • Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.

  • Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.

  • Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.

Notable Quotes

"When I was asked how I measure success, I said the day I no longer have to convince you."

"62% of people said literally we don't know how to measure the value of design ops yet."

"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."

"People really hated using Harvest to log billable hours, some just put the same hours week after week."

"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."

"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."

"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."

"You can’t have effective teams without happy designers and better designers; they’re interdependent."

"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."

"Our call to action is to co-create these measurement standards together and share back to the community."

Ask the Rosenbot
Deirdre Hirschtritt
Research is Only as Good as the Relationships You Build
2022 • Civic Design 2022
Gold
Lija Hogan
Contexts of Use: A Framework for Connection
2021 • Civic Design 2021
Gold
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Dave Malouf
Closing Keynote: Amplify. Not Optimize.
2019 • DesignOps Summit 2019
Gold
Jane Reid
Self-care in User Research
2020 • Advancing Research Community
Nicole Umphress
Delivering Design Education During a Global Pandemic: Lessons Learned
2022 • Design at Scale 2022
Gold
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Conference
Erika Flowers
AI-Readiness: Preparing NASA for a Data-Driven, Agile Future
2025 • Designing with AI 2025
Gold
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Renee Reid
Becoming a ResearchH.E.R (Highly Enterprise Ready)
2019 • Enterprise Experience 2019
Gold
Katie Hansen
Experimental research: techniques for deep, psychology-driven insights
2025 • Advancing Research 2025
Gold
Matteo Gratton
Can Data and Ethics Live Together?
2021 • DesignOps Summit 2021
Gold
Phil Hesketh
Designing Accessible Research Workflows
2021 • DesignOps Summit 2021
Gold
Dave Hora
Advice for Establishing Research
2022 • Advancing Research Community
Katie Hansen
Finding the unknown in the known: Harnessing meta-analysis and literature review
2025 • Advancing Research 2025
Gold
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold

More Videos

Brad Peters

"A lot of times those data streams are acting somewhat independently."

Brad Peters Anne Mamaghani

Short Take #1: UX/Product Lessons from Your Industry Peers

December 6, 2022

Lona Moore

"You don’t have to be a designer to participate; over 90% of our community are not design professionals."

Lona Moore

Scaling Design Beyond Designers

June 11, 2021

Josh Clark

"Machine intelligence can elevate experiences by easing frictions and amplifying human judgment and agency."

Josh Clark Veronika Kindred

Sentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)

January 15, 2025

Erin May

"Stakeholders aren’t ready to write their own briefs or manage recruitment, so it ended up being a hybrid model initially."

Erin May Roberta Dombrowski Laura Oxenfeld Brooke Hinton

Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org

March 10, 2022

Tara Tressel

"AI moderation, in short, is a large language model that runs a moderated interview session without a human researcher present."

Tara Tressel

Investigating qualitative depth of AI-moderated interviews

March 10, 2026

Charles Lee

"It's really about finding a way to link all the different aspects to bring everything together to tell the story."

Charles Lee Jennie Yip

Building a New Home for the Atlassian Design System

October 22, 2020

Kristin Skinner

"Teachers need actionable insights, not just raw data."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Megan Blocker

"User researchers stop at findings and insights, but often do not advocate for a direction."

Megan Blocker

Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research

March 26, 2024

Shanti Mathew

"Shared mental models serve as organizing frameworks that all players in the system can understand and make decisions within."

Shanti Mathew Natalie Sims Natalia Radywyl

Civic Design at Scale: Introducing the Public Policy Layer Cake

December 9, 2021