Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Greg Nudelman
Designing Conversational Interfaces
2019 • Enterprise Community
Jorge Arango
Meeting of the Waters: Designing for Successful Inorganic Growth
2021 • Enterprise Community
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Sam Proulx
Prototype Reviews, People With Disabilities, and You
2021 • Civic Design 2021
Gold
Michael Weir
Mixed Methods and Behavioural Science
2023 • Rosenfeld Community
Angy Peterson
More Than Technology: Personalized Public Sector Experiences
2021 • Civic Design 2021
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • DesignOps Summit 2022
Gold
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Gretchen Anderson
Scaling the Human Center
2017 • Enterprise Experience 2017
Gold
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Sarah Fathallah
Beyond insights: Rethinking the role of researchers as stewards of organizational wisdom
2025 • Advancing Research 2025
Gold
Lada Gorlenko
Theme 3: Introduction
2021 • Design at Scale 2021
Gold
Jacqui Frey
Scale is Social Work
2020 • DesignOps Community
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold

More Videos

Joerg Beringer

"You get a lot of different research outputs in a matter of minutes from your scope input."

Joerg Beringer Thomas Geis

Scaling User Research with AI: Continuous Discovery of User Needs in Minutes

June 10, 2025

Nidhi Singh Rathore

"Participatory research feels more like improv, not a scripted play; you don't know where the session will go, which is exciting."

Nidhi Singh Rathore Amber Davis

Embracing participation to unlock deeper truths in commercial research

March 12, 2025

Mackenzie Cockram

"Having the qualitative and quantitative data together lets us tell a comprehensive story to stakeholders."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022

Jamie Beck Alexander

"Google Maps’ Leaf visualization helps people normalize efficient driving, demonstrating the power of design in behavior change."

Jamie Beck Alexander Nina Gregg Shawn Petersen Bill DeRouchey

How can you find your role in climate?

January 17, 2024

Caroline Vize

"We saw one insurance form took 14 minutes to fill, and that was longer than competitor journeys, helping identify a clear target for improvement."

Caroline Vize

The State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022

March 9, 2022

Dr. Karl Jeffries

"Are you creative? Such a loaded question, isn't it?"

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Alberto Ferreira

"Including human stories alongside numbers helps business leaders grasp the complexity behind the metrics."

Alberto Ferreira

Making it Count: Developing a custom digital metric framework that works

October 15, 2021

Shipra Kayan

"AI can act like a super eager intern who's very confident but sometimes gets things wrong."

Shipra Kayan Robert Kortenoeven Eileen Tang

Emerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow

June 11, 2025

Dana Bishop

"In 2019, 74% of survey respondents relied mostly on in-person moderated interviews for UX insights."

Dana Bishop

2022: The Year UX Demonstrates its Business Impact

March 11, 2022