Rosenverse
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Jenny Price
From Tradition to Transformation: Unlocking Startup Agility in a Legacy Enterprise
2025 • DesignOps Summit 2025
Gold
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Robin Beers
Research as a Catalyst for Organizational Transformation
2021 • Advancing Research 2021
Gold
Megan Clegg
Space for Everyone: Reframing Accessibility Through a Wider Lens
2021 • Design at Scale 2021
Gold
Sharon Bautista
Time to Make the Donuts: How User Research Helped Bridge Disparate Teams
2024 • Enterprise Experience 2020
Gold
Kate Stern
Scaling Learning for the Future
2022 • DesignOps Summit 2022
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Vicky Teinaki
Short Take #3: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Changying (Z) Zheng
From prototype to production: Vibe coding design for real engineering systems
2026 • Designing with AI 2026
Conference
Dan Willis
Enterprise Storytelling Sessions
2016 • Enterprise UX 2016
Gold
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps Summit 2024
Gold

More Videos

Saara Kamppari-Miller

"Who works here anyways? I knew about immediate teams but beyond that, it was a fog."

Saara Kamppari-Miller

Cartography for Design Communities

September 10, 2025

Zariah Cameron

"We have to ask who is not in the room and whether representation truly reflects the target audience."

Zariah Cameron

Streamlining an Inclusive Design Practice

October 3, 2023

Catt Small

"If you are inputting really awesome human-created content, AI can synthesize something of quality, but it doesn’t create quality itself."

Catt Small

How the most senior designers are using AI in their work right now

July 1, 2026

Ned Dwyer

"Tool consolidation opened up space for conversation and collaboration across teams."

Ned Dwyer Jadyn Aguilar

The Future of DesignOps is Tool Consolidation

September 23, 2024

Billy Carlson

"If you can get all the people in an organization rowing in the same direction, you could dominate any industry at any time."

Billy Carlson

Ideation tips for Product Managers

December 6, 2022

Kim Holt

"Clear and consistent communication really keeps design leadership accountable and promotes transparency via knowledge sharing."

Kim Holt Emma Wylds Pearl Koppenhaver Maisee Xiong

A Salesforce Panel Discussion on Values-Driven DesignOps

September 8, 2022

Zen Ren

"Using cognitive dimensions to analyze findings helps clarify which recommendations to make and keeps us in the real problem context."

Zen Ren

Taking Inspiration from Instructional Design for Research

March 10, 2022

Tina Weisser

"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."

Tina Weisser

When AI Agents Meet Reality. Service Design Lessons from a Pilot

February 26, 2026

B. Pagels-Minor

"Netflix said I could be me every day, but then they released content that deeply hurt people on my team."

B. Pagels-Minor

Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically

June 10, 2022