Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Jon Fukuda
Storytelling for DesignOps
2023 • DesignOps Community
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Shawna Hein
Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
2022 • Civic Design 2022
Gold
Kara Kane
Theme One Intro
2022 • Civic Design 2022
Gold
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Anna Nguyen
Why Our Voice of the Customer is Better Than Yours
2022 • Advancing Research 2022
Gold
Anupama Dhareshwar
From blueprint to bot: Designing resilient AI-powered services
2025 • Advancing Service Design 2025
Gold
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Dr. Jamika D. Burge
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Ryan Matthew
DesignOps without Boundaries: Building More with What You Have
2025 • DesignOps Summit 2025
Gold
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Nathan Reiff
Research, from Unimaginable to Presently Possible: A Future-Casting Sticky-Note Sprint
2026 • Advancing Research 2026
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Brigette Metzler
Research Repositories: A global project by the ResearchOps Community
2020 • Advancing Research Community
Jen Briselli
Learning Is The Engine: Designing & Adapting in a World We Can’t Predict
2025 • Rosenfeld Community

More Videos

Daniel J. Rosenberg

"Human beings understand graphical user interfaces as composed of objects and actions—this grammar is key to AI design."

Daniel J. Rosenberg

Designing with and for Artificial Intelligence

August 11, 2022

"Many candidates are filtered out by ATS systems due to keyword matching that overlooks valuable but unconventional experience."

DesignOps and The Great Talent War of 2021

August 19, 2021

Liwei Dai

"By identifying the triggers that lead customers to ask questions, I helped data scientists figure out what training data to explore."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Gina Mendolia

"Program managers are the unsung heroes who can back up design ops work in many organizations."

Gina Mendolia Jasmine Toy

Coordinated collaboration: a Service Design & DesignOps love story

November 19, 2025

Jon Temple

"An SOW at LinkedIn takes six to eight weeks, and by then sometimes the project isn’t even relevant anymore."

Jon Temple Kalee Dankner Bruce Falk Lauren Galanter

Panel: Stacks, Security, and Stakeholders: The Hidden Work of UXR Tool Procurement

March 12, 2026

Mark Interrante

"Side-pav proposals answer what’s going on, why it matters now, what you propose, what action to take, and what benefit comes from it."

Mark Interrante

Collaboration Flows in Product Development

June 9, 2017

Bria Alexander

"Sponsors make this conference possible, without them we wouldn't be here talking about some incredibly interesting things."

Bria Alexander

Opening Remarks

September 30, 2021

Peter Van Dijck

"Don’t overcomplicate workflows; the simplest thing that could possibly work is often best."

Peter Van Dijck

Hands on AI #3: Claude Code for UX people

October 22, 2025

Rachael Dietkus, LCSW

"Even if there is an element of enrichment in research participation, all processes have some extraction and must be minimized."

Rachael Dietkus, LCSW Uday Gajendar Dr. Dawn Emerick Dawn E. Shedrick, LCSW

Leading through the long tail of trauma

July 7, 2022