Summary
Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.
Key Insights
-
•
Dark metrics focus on the negative impacts of digital health technologies.
-
•
Basic product metrics often ignore the user's holistic experience and needs.
-
•
Disempowerment occurs when technology impairs an individual's autonomy.
-
•
Exclusion can manifest through implicit biases in technology design.
-
•
Addiction in technology often leads to excessive use and unhealthy dependencies.
-
•
Distraction from digital technologies can hinder workflow and engagement in healthcare settings.
-
•
Designers should prioritize ethical frameworks to measure success.
-
•
Incorporating diverse perspectives helps identify unintended consequences early.
-
•
Ethical considerations in design should be part of the profit model in businesses.
-
•
Continuous evaluation and adjustment of metrics is crucial in tech design.
Notable Quotes
"A Pinterest is worth a thousand words."
"The measure of a man is what he does with power."
"Designing is about augmenting intelligence, not replacing it."
"The actual algorithm didn’t make explicit mention to race as a variable."
"I can tell that a lot of these new health technologies are not stress tested in real world environments."
"Our ultimate goal is to make sure that racial equity is embedded into every aspect of our design culture."
"Let’s have diverse co-creation from the beginning to reduce bias."
"Not every diverse population will have the same experiences; I don't have every black experience."
"The first step is to identify where and how we might be exclusionary."
"Raising awareness around dark metrics is essential for user advocacy."
More Videos
"Look for patterns; some of those are repeating."
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018
"Every time we communicate, we are indeed sharing a basic need for human connection."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"The product leadership doesn't see the value in research and they're thinking about shutting the research team down."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"Take advantage of our sponsor sessions because they are really high quality and free."
Bria AlexanderDay 3 Welcome
September 25, 2024
"If you have really good ideation techniques built into your design process, you can save a lot of time later on and a lot of headaches."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022
"It’s crucial to bridge connections between different teams to avoid siloed insights and foster collaboration."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021
"Onboarding processes should empower new hires to integrate smoothly into the team."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"What's the last bad experience you had with another discipline?"
Adrian HowardSturgeon’s Biases
September 25, 2024
"I've learned to ask, to be invited to key stakeholder meetings."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023
