Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Carol Scott
Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices
2025 • Rosenfeld Community
Jessamyn Edwards
Surviving Your UX Career in Enterprise Design
2021 • Enterprise Community
Corey Nelson
Layoffs
2022 • Advancing Research Community
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Enterprise UX 2023
Gold
Erin Weigel
Testing and Experimentation Tools
2026 • Advancing Research 2026
Gold
Jilanna Wilson
Distributed DesignOps Management
2019 • DesignOps Community
Josh Clark
Sentient Design: Crafting Intelligent Interfaces with AI
2026 • Designing with AI 2026
Conference
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold
Sean McKay
Coexisting with non-researchers: Practical strategies for a democratized research future
2025 • Advancing Research 2025
Gold
Chris Chapo
Data Science and Design: A Tale of Two Tribes
2015 • Enterprise UX 2015
Gold
Deanna Washington
Scaling Success: Paving the Path from DesignOps to VP
2023 • DesignOps Summit 2023
Gold
Catt Small
Craft a Vision that Actually Gets Shipped
2026 • Rosenfeld Community
Sofía Delsordo
Public Policy for Jalisco's Designers to Make Design Matter
2021 • Civic Design 2021
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Ed Mullen
Designing the Unseen: Enabling Institutions to Build Public Trust
2022 • Civic Design 2022
Gold
Sam Ladner
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Mariesa Lenz

"Leadership is not about having all the answers but facilitating conversations with experts to find solutions."

Mariesa Lenz

What Beekeeping Taught me about Product Teams

October 29, 2025

Jorge Arango

"Hypertext notes coexist on the same level and link to each other arbitrarily, creating emergent structures."

Jorge Arango

Exploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)

April 19, 2024

Peter Van Dijck

"You can’t just be a designer adapting UX workflows assuming everybody else’s workflow stays the same; everything is changing with AI."

Peter Van Dijck

Hands on AI #3: Claude Code for UX people

October 22, 2025

Ovetta Sampson

"Generative AI has no moral code; you have to discipline it so it can learn right from wrong."

Ovetta Sampson

Managing the Human Engagement Risks of AI

June 10, 2025

B. Pagels-Minor

"In second grade, I was sent to the principal’s office almost every day just for raising my hand."

B. Pagels-Minor

Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically

June 10, 2022

Amy Bucher

"Logic models are boring but powerful tools to align expectations that behavior change is complex and not immediate."

Amy Bucher

Harnessing behavioral science to uncover deeper truths

March 12, 2025

Matt Bernius

"If you work with humans, you work with trauma. Assume everybody carries some form of vulnerability."

Matt Bernius Sarah Fathallah Hera Hussain Jessica Zéroual-Kara

Trauma-informed Research: A Panel Discussion

October 7, 2021

Sam Proulx

"Consistency means the same interactions always do the same things; buttons are in the same place, and flows don’t change suddenly."

Sam Proulx

Online Shopping: Designing an Accessible Experience

November 29, 2023

Kritika Sony

"You don’t have to build a game; maybe you want to build a toy for your cat or a lamp—it just has to be yours."

Kritika Sony

Moving AI offscreen: Exploring failures, constraints, and recovery in physical game design

June 10, 2026