Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Vanessa Varin
Feedback: The Other F-Word
2025 • DesignOps Summit 2025
Gold
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Russ Unger
Onboarding: The Ecosystem, not the Afterthought
2017 • DesignOps Summit 2017
Gold
Jorge Arango
Meeting of the Waters: Designing for Successful Inorganic Growth
2021 • Enterprise Community
Lada Gorlenko
Theme 2 Intro
2022 • Design at Scale 2022
Gold
Alnie Figueroa
The Future of Design Operations: Transforming Our Craft
2025 • DesignOps Summit 2025
Gold
Robert Fabricant
Industry junctures: Paths forwards for UXR and the critical decisions that get us there [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Carol Scott
Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices
2025 • Rosenfeld Community
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold
Kyria Stephens
Power to Heal: Civic Design in the Aftermath of Tragedy
2022 • Civic Design 2022
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Sahibzada Mayed
The Politics of Radical Research: A Manifesto
2023 • Advancing Research 2023
Gold
Lija Hogan
Contexts of Use: A Framework for Connection
2021 • Civic Design 2021
Gold
Frances Yllana
Theme 2 Intro
2024 • DesignOps Summit 2024
Gold
Patrick Commarford
Design Staffing for Impact
2024 • DesignOps Summit 2020
Gold
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire
2022 • Civic Design Community

More Videos

Lena Shenkarenko

"Climate change is not just a distant threat; it's happening here and now in our cities."

Lena Shenkarenko

Collaborative Wireframing for Creating Team Alignment and Shipping Better Products

October 21, 2020

Bob Baxley

"We recommend pausing the focus on NPS score to coach behaviors that drive long-term customer relationships."

Bob Baxley Sara Asche Anderson Sharon Bautista Frank Duran Jamie Kaspszak Abbey Smalley Sylas Souza

Theme 4: Discussion

January 8, 2024

Laine Riley Prokay

"This is not a checklist or promotion tool; you don’t have to excel in everything to grow."

Laine Riley Prokay

How DesignOps can Drive Inclusive Career Ladders for All

September 30, 2021

Paul Pangaro, PhD

"You have to be responsible for your viewpoint—you can't claim objectivity and ignore the impact."

Paul Pangaro, PhD

Systems Disciplines: Table Stakes for 21st Century Organizations

June 6, 2023

Uday Gajendar

"Sponsor sessions are not just salesy sessions; they’re actually really fantastic sessions put on by your peers."

Uday Gajendar Louis Rosenfeld

Day 1 Welcome

June 4, 2024

Bianca Jefferson

"Start small, add scaffolding, and let momentum do the rest."

Bianca Jefferson

From Sprints to Systems: Operationalizing Continuous Discovery Through DesignOps

September 10, 2025

Chris Geison

"What am I personally doing to contribute to the dynamics that stand in the way of better futures?"

Chris Geison

Theme 1 Intro

March 9, 2022

Teresa Swingler

"We encourage canceling programs very fast if research shows lack of need to avoid wasted effort."

Teresa Swingler

Look, Up in the Sky! UX/UI for Aerospace

October 27, 2022

Amy Paris

"People use gender and sex interchangeably, but as identities evolve, that creates complications for medical and benefit forms."

Amy Paris Danielle Thierry

Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities

December 9, 2021