Rosenverse
Group Activity: A Deep Dive Into Value and Outcomes

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Group Activity: A Deep Dive Into Value and Outcomes

Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Group Activity: A Deep Dive Into Value and Outcomes
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • 62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.

  • Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.

  • Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.

  • Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.

  • Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.

  • Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.

  • An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.

  • Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.

  • Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.

  • Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.

Notable Quotes

"When I was asked how I measure success, I said the day I no longer have to convince you."

"62% of people said literally we don't know how to measure the value of design ops yet."

"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."

"People really hated using Harvest to log billable hours, some just put the same hours week after week."

"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."

"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."

"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."

"You can’t have effective teams without happy designers and better designers; they’re interdependent."

"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."

"Our call to action is to co-create these measurement standards together and share back to the community."

Ask the Rosenbot
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Jeff Ephraim Bander
Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research
2022 • Advancing Research 2022
Gold
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Kristen Guth, Ph.D.
Out of the FOG: A Non-traditional Research Approach to Alignment
2023 • Advancing Research 2023
Gold
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Gold
Robin Beers
Research as a Catalyst for Organizational Transformation
2021 • Advancing Research 2021
Gold
Josh Clark
Sentient Design: Crafting Intelligent Interfaces with AI
2026 • Designing with AI 2026
Conference
Mike Oren
Design Research Strategy & Strategic Design Research
2022 • Advancing Research Community
Harry Max
Failure Friday #5: Lessons from a SaaS Design Failure
2025 • Rosenfeld Community
Jorge Arango
The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)
2024 • Rosenfeld Community
Steve Krug
Don’t Make Me Think 3.0: What Endures and What Evolves in UX
2026 • Advancing Research 2026
Gold
Sam Proulx
Prototype Reviews, People With Disabilities, and You
2021 • Civic Design 2021
Gold
Noreen Whysel
Short Take #4: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Jilanna Wilson
Distributed Design Operations Management
2019 • DesignOps Summit 2019
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Liz Ebengo
The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward
2024 • Advancing Service Design 2024
Gold

More Videos

Darian Davis

"By observing Jeff's concerns and asking questions, I was able to show empathy and distract myself from getting defensive."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Indi Young

"Thinking styles are not horoscopes or Myers-Briggs; they only apply within a specific frame of intent or goal."

Indi Young

Thinking styles: Mend hidden cracks in your market

January 8, 2025

Louis Rosenfeld

"The sponsor sessions are equal in quality and quantity as our main programming and completely free for anyone to attend."

Louis Rosenfeld Bria Alexander

Day 1 Welcome

September 23, 2024

Melissa Schmidt

"We ditched the lab coats because they were a little off-putting."

Melissa Schmidt Adam Menter

How UX Research Hit It Big in Las Vegas

June 4, 2019

Kristin Skinner

"People spend about 60% of their time on the work about the work."

Kristin Skinner Kamdyn Moore

8 Types of Measures in Design Operations

April 16, 2020

Dave Hora

"If research findings aren’t connected to action, then you’re just planning and not actually doing strategy."

Dave Hora

Advice for Establishing Research

December 8, 2022

Sean Fitzell

"This jobs map became the single source of truth deliverable anyone in the organization could reference."

Sean Fitzell Sarah Han Kayla Farrell

Craft of User Research: Building Out Jobs to be Done Maps

March 12, 2021

Jason Mesut

"The important thing was the conversation around it. Do it quickly, explain your thinking, have a discussion."

Jason Mesut

Shaping design, designers and teams

November 8, 2018

Dante Guintu

"Engagement at hiring, onboarding, and growth stages prevents talent churn."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022