Summary
Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.
Key Insights
-
•
Dark metrics focus on the negative impacts of digital health technologies.
-
•
Basic product metrics often ignore the user's holistic experience and needs.
-
•
Disempowerment occurs when technology impairs an individual's autonomy.
-
•
Exclusion can manifest through implicit biases in technology design.
-
•
Addiction in technology often leads to excessive use and unhealthy dependencies.
-
•
Distraction from digital technologies can hinder workflow and engagement in healthcare settings.
-
•
Designers should prioritize ethical frameworks to measure success.
-
•
Incorporating diverse perspectives helps identify unintended consequences early.
-
•
Ethical considerations in design should be part of the profit model in businesses.
-
•
Continuous evaluation and adjustment of metrics is crucial in tech design.
Notable Quotes
"A Pinterest is worth a thousand words."
"The measure of a man is what he does with power."
"Designing is about augmenting intelligence, not replacing it."
"The actual algorithm didn’t make explicit mention to race as a variable."
"I can tell that a lot of these new health technologies are not stress tested in real world environments."
"Our ultimate goal is to make sure that racial equity is embedded into every aspect of our design culture."
"Let’s have diverse co-creation from the beginning to reduce bias."
"Not every diverse population will have the same experiences; I don't have every black experience."
"The first step is to identify where and how we might be exclusionary."
"Raising awareness around dark metrics is essential for user advocacy."
More Videos
"Leadership is best when people barely know she exists."
John MaedaMaking Sense of Enterprise UX
June 9, 2016
"We’re looking at them by their interior cognition, their inner thinking, their emotional reactions."
Indi YoungThinking styles: Mend hidden cracks in your market
January 8, 2025
"It doesn't matter what the insight is if no one does anything with it."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"The creation of trust leads to better communication tools."
Elizabeth ChurchillExploring Cadence: You, Your Team, and Your Enterprise
June 8, 2017
"We really encourage wherever you are because those are great connecting points."
Rusha SopariwalaRemote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
June 9, 2022
"We mostly have something called BYOE, or bring your own ethics, in the design industry."
George AyeThat Quiet Little Voice: When Design and Ethics Collide
November 16, 2022
"I learned that being in the red for one person was crying and for another, it was complete silence."
Ariba JahanTeam Resiliency Through a Pandemic
January 8, 2024
"Design can help create a better world by fostering empathy and collaboration."
Julie Gitlin Esther RaiceDesign as an Agent of Digital Transformation at JPMC
June 9, 2021
"We are living in a world made of data and everything that is digital is generating it."
Matteo GrattonCan Data and Ethics Live Together?
October 1, 2021
