Rosenverse
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community
Daniel J. Rosenberg
Designing with and for Artificial Intelligence
2022 • Enterprise Community
Crystal Yan
Building a Customer-Centric Culture
2020 • Advancing Research 2020
Gold
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Kristin Skinner
Theme 1 Intro
2021 • DesignOps Summit 2021
Gold
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Gold
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
David Cronin
Discussion
2015 • Enterprise UX 2015
Gold
Iulia Cornigeanu
QuantQual Book Club: Small Data
2024 • QuantQual Interest Group
Steve Portigal
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Christian Rohrer
Research Operations at Scale
2017 • DesignOps Summit 2017
Gold
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Marc Rettig
Discussion
2015 • Enterprise UX 2015
Gold

More Videos

Chris Hammond

"Publishing a position paper at IBM takes months of review to align all stakeholders and avoid any suggestion of greenwashing."

Chris Hammond

Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"

April 2, 2025

Bria Alexander

"Check out our digital swag bag—our sponsors put a lot of effort into making compelling offers for all of you here today."

Bria Alexander

Opening Remarks

September 29, 2021

Jen Cardello

"The insights to action ratio tracks how many insights are acted upon, providing measurable impact."

Jen Cardello Dr. Shadi Janansefat Alex Wright

Curating insight: Strategies for integrating knowledge across research functions

March 11, 2025

Rebecca Buck

"If your recreational reading is about prison camp survivorship or hostage negotiations, you might have burnout."

Rebecca Buck

Mission: Keep Talent in Research Roles!

March 10, 2021

Abby Covert

"A lot of these tools bring more noise into people’s day to day lives. It’s really hard to stay involved and still find time to get your own job done."

Abby Covert Tomer Sharon

Panel: Collaboration Tools

November 6, 2017

Llewyn Paine

"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."

Llewyn Paine

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

March 11, 2025

Uday Gajendar

"Cheryl will connect design thinking approaches to systems thinking, laying down foundational concepts."

Uday Gajendar

Theme One Intro

June 6, 2023

Meaghan Waters

"Hubris is that belief the market will wait for your big bang release—executives have lost jobs over this."

Meaghan Waters Fotina Koutropoulous

Lack of Product Thinking will Doom Your Legacy Modernization

June 9, 2021

Alastair Simpson

"A shared understanding of how you got here creates a sense of purpose, not just urgency."

Alastair Simpson

Debunking the Myths of Cross-Disciplinary Collaboration

October 24, 2019