Rosenverse
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant.

In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them.

Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • •

    60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • •

    Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • •

    Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • •

    Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • •

    Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • •

    Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • •

    Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • •

    Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • •

    Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • •

    A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Bria Alexander
Theme 1 Intro
2024 • DesignOps Summit 2024
Gold
Heidi Trost
To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity
2025 • Rosenfeld Community
Jen Crim
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Anna Avrekh
Expert Panel: Leading in and with Research
2022 • Advancing Research 2022
Gold
Amy Paris
Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities
2021 • Civic Design 2021
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Yulya Besplemennova
[Demo] Stress-testing GenAI in user research synthesis
2024 • Designing with AI 2024
Gold
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
April Reagan
Look, Think, Act: The Futures-Smart Design Organization
2021 • DesignOps Summit 2021
Gold
Dave Hora
Advice for Establishing Research
2022 • Advancing Research Community
Jim Kalbach
Jobs To Be Done
2021 • Enterprise Community
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold
Zariah Cameron
ReDesigning Wellbeing for Equitable Care in the Workplace
2024 • DesignOps Summit 2024
Gold
Ashley Sewall
Exit Interview #5: Designing My Life After Tech
2026 • Rosenfeld Community

More Videos

Tony Turner

"A taxonomy system is basically a way to tag different findings and reports so you can find relationships later."

Tony Turner

Capturing Deep Insights

September 30, 2021

Frances Yllana

"Designers have long thought of themselves as heroes, but we had to unpack that conception."

Frances Yllana Ann Buechner Jess Jones Betsy Ramaccia

D.E.A.R.R. Diaries (Discipline, Experience, Architecture, Reflection + Revolution)

November 16, 2022

Anna Poznyakov

"How do we continuously provide value throughout the product development cycle without overindexing on just one type of research?"

Anna Poznyakov Richa Prajapati

Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact

March 12, 2021

Sarah Williams

"Using language that’s already common within the company helps principles feel natural and easy to adopt."

Sarah Williams

A Framework for CX Transformation

June 11, 2021

"Good UX is good business."

Product and Design at Bloomberg: A 15-year Evolution

December 6, 2022

David Cronin

"A lot of people were just going and downloading the tear sheet, which is to be expected."

David Cronin

The GE Design System and Thoughts about Craft at Scale

May 13, 2015

Liwei Dai

"After more than 10 years of doing UX research, I was still only working above the iceberg, focusing on the usability and feature level."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Peter Van Dijck

"Without a golden dataset, you have to build the golden dataset yourself."

Peter Van Dijck

Hands-on AI #1: Let’s write your first AI eval

October 8, 2025

Jon Fukuda

"Without a human in the loop, AI can go off and do crazy disastrous things."

Jon Fukuda Amy Evans Ignacio Martinez Joe Meersman

The Big Question about Innovation: A Panel Discussion

September 25, 2024

Latest Books All books