Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Marc Rettig
Discussion
2015 • Enterprise UX 2015
Gold
April Reagan
Look, Think, Act: The Futures-Smart Design Organization
2021 • DesignOps Summit 2021
Gold
Uday Gajendar
10 Years of Enterprise UX: Reflecting on the community and the practice
2025 • Enterprise Community
Victor Lombardi
Bridging Design and Climate Science
2024 • Climate UX Interest Group
Billy Carlson
Pro-level UI Tips for Beginners
2022 • DesignOps Summit 2022
Gold
Laureen Kattan
Centering Patients and Clinicians in a Complex Government Ecosystem
2023 • Design in Product 2023
Gold
Chris Geison
What's Next for Research?
2021 • Advancing Research Community
Peter Van Dijck
Designing AI-first products on top of a rapidly evolving technology
2025 • Designing with AI 2025
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Yulya Besplemennova
[Demo] Stress-testing GenAI in user research synthesis
2024 • Designing with AI 2024
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold
Alison Rand
Scaling Impact with Service Design
2021 • DesignOps Community
Ricardo Martins
Unlocking the power of advanced quantitative methods
2025 • Advancing Research 2025
Gold
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community
Courtney Maya George
Scale Your Organization and Grow Your Designers
2022 • DesignOps Summit 2022
Gold
Amelia Cole
Data-Prompted Interviews
2021 • QuantQual Interest Group

More Videos

Dave Hora

"Establishing research is years-long work, requiring coordinated action, self-awareness, rigor, and honest assessment."

Dave Hora

Advice for Establishing Research

December 8, 2022

Sam Yen

"Are we excited to go to work in the technology industry to remove jobs and eliminate the human from the equation?"

Sam Yen

Driving Organizational Change Through Design? Do more of this and less of that

June 9, 2017

Dr. Jamika D. Burge

"Building for humans is a huge challenge because humans are multi-layered, weird, and wonderful irrational creatures."

Dr. Jamika D. Burge Robert Fabricant Peter Merholz Noam Segal Teresa Torres

A Genuine Conversation about the Future of UX Research

March 20, 2024

Kate Kalcevich

"I recommend asking about user needs rather than disability, like whether someone needs captions or larger fonts."

Kate Kalcevich

Integrating Accessibility in DesignOps

September 23, 2024

Isaac Heyveld

"Emotional intelligence is key to navigating situations with senior leaders multiple grades above you."

Isaac Heyveld

Expand DesignOps Leadership as a Chief of Staff

September 8, 2022

Jemma Ahmed

"Dane helps us understand that psychology is not just about the mind, but also deeply held in the body."

Jemma Ahmed

Theme 2 Intro

March 26, 2024

Sahibzada Mayed

"What role does time play as a form of currency in contributing to extractive methods of research?"

Sahibzada Mayed

The Politics of Radical Research: A Manifesto

March 27, 2023

Jon White

"We are not just doing research to find stuff out; we need to show a return on investment on everything."

Jon White Erin May

Unsticking Research for Better Information Flow

March 11, 2026

PJ Buddhari

"We try to keep things as consistent as possible in terms of the API but document where platforms need to deviate to be good citizens of their environment."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021