Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Kyle Godbey
Non-linear service design for complex adaptive systems
2025 • Rosenfeld Community
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Molly Fargotstein
Multipurpose Communication & UX Research Marketing
2019 • DesignOps Community
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold
Robert Schwartz
We're Here for the Humans
2017 • Enterprise Experience 2017
Gold
Patrizia Bertini
The (r)evolution of designOps: It’s Time to Think (really) BIG
2025 • DesignOps Summit 2025
Gold
Chui Chui Tan
Global insights: Embracing international and intercultural research for innovation
2025 • Advancing Research 2025
Gold
Jon Fukuda
All the Ops: Successful cross-functional collaboration
2025 • DesignOps Summit 2025
Gold
Stephanie Wade
Building and Sustaining Design in Government
2021 • Civic Design 2021
Gold
Jose Coronado
From Zero to Hero
2022 • DesignOps Summit 2022
Gold
Neil Barrie
Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
2024 • Advancing Research 2024
Gold
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps Summit 2024
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Mike Oren
Why Pharmaceutical's Research Model Should Replace Design Thinking
2023 • Advancing Research 2023
Gold

More Videos

Victor Udoewa

"Land acknowledgments don’t actually change the allocation of power or resources; they work at the mythological level."

Victor Udoewa

Radical Participatory Design: Decolonizing Participatory Design Processes

December 10, 2021

Scott Stephens

"Notion really became a single source of truth where you can go for any context around the work."

Scott Stephens

The Next Generation in DesignOps Toolsets

July 28, 2022

Sam Proulx

"Diverse teams build diverse products that work for more people."

Sam Proulx

Accessibility: An Opportunity to Innovate

September 8, 2022

Mujtaba Hameed

"The retina is a primary brain surface; when we look at things differently, we think differently."

Mujtaba Hameed

Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research

March 26, 2024

Michele Wong

"Their success is our success, especially when you treat external designers as part of the team."

Michele Wong

Helping Them Help Us

January 8, 2024

Tala Tayebi

"Insights are not the end; they must lead to decisions and improved user outcomes."

Tala Tayebi Kelly Goto Jared Spool

Voice and influence in an age of noise

March 10, 2026

Adam Thomas

"If you’re not investing or quitting something, what is the point of having a strategy?"

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Wendy Johansson

"There is a tension between moving faster and going deeper, and the way through is tapping into the huge reservoir of creative capital in organizations."

Wendy Johansson Surya Vanka

Design at Scale: Behind the Scenes

April 29, 2021

Tess Dixon

"Creating moments of joy in the day can encourage positive behaviors and brighten people’s days."

Tess Dixon

C'mon Get Happy

September 29, 2021