Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Summary
When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.
Key Insights
-
•
60-90% of product ideas do not improve intended metrics, causing waste and burnout.
-
•
Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.
-
•
Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.
-
•
Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.
-
•
Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.
-
•
Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.
-
•
Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).
-
•
Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.
-
•
Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.
-
•
A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.
Notable Quotes
"60 to 90% of our ideas do not improve the metrics they were intended to improve."
"Everyone has a plan until they get punched in the mouth, said Mike Tyson."
"Feature roadmaps are bad because over time coherent actions become noise."
"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."
"Stop, pivot, or invest early—these are the survival metric decisions that save companies."
"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."
"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."
"You have to ask, what are we deciding, and what are we quitting, on a regular basis."
"If you’re not investing or quitting something, what is the point of having a strategy?"
"Repetition, representation, and association are the keys to great theater and great product development."
Or choose a question:
More Videos
"Many culture-building moments at Shopify happen because individual contributors see opportunity and take action."
Amy ThibodeauOpening Keynote: Process and Ambiguity
October 23, 2019
"The biggest problem was to solve the engagement problem first with the sponsor, then the team, then external stakeholders."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"Communicating in an academic or marketing way builds suspense instead of building trust."
Bruce GillespieLearning from journalism: Balancing impactful communication with compassionate storytelling
March 13, 2025
"Product managers often see design work as a black box and want transparency and accountability."
Aurobinda Pradhan Shashank DeshpandeIntroduction to Collaborative DesignOps using Cubyts
September 9, 2022
"Setting up a repository as a team of one or two is actually the prime time to establish processes like that."
Taylor Jennings Joe Nelson Alex KnollRepository Retrospective: Learnings from Introducing a Central Place for UX Research
March 9, 2022
"If patients stop using the app because they’ve got their health under control, that’s like a dating app success — they got married, not that the app failed."
Daniel J. RosenbergDigital Medicine Design
September 26, 2019
"Proactive measurement before release combined with post-release evaluation is the ideal approach."
Jack MoffettUX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
September 22, 2022
"I’ve created dedicated personas in the bots, like a chief of staff and lead developer, to keep roles clear."
Christian CrumlishThe Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…
August 14, 2025
"Hiring team members with lived experience was key for authentic engagement and facilitating workshops."
Alexia Cohen Adriane AckermanIncreasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
December 4, 2024
