Summary
Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.
Key Insights
-
•
Dark metrics focus on the negative impacts of digital health technologies.
-
•
Basic product metrics often ignore the user's holistic experience and needs.
-
•
Disempowerment occurs when technology impairs an individual's autonomy.
-
•
Exclusion can manifest through implicit biases in technology design.
-
•
Addiction in technology often leads to excessive use and unhealthy dependencies.
-
•
Distraction from digital technologies can hinder workflow and engagement in healthcare settings.
-
•
Designers should prioritize ethical frameworks to measure success.
-
•
Incorporating diverse perspectives helps identify unintended consequences early.
-
•
Ethical considerations in design should be part of the profit model in businesses.
-
•
Continuous evaluation and adjustment of metrics is crucial in tech design.
Notable Quotes
"A Pinterest is worth a thousand words."
"The measure of a man is what he does with power."
"Designing is about augmenting intelligence, not replacing it."
"The actual algorithm didn’t make explicit mention to race as a variable."
"I can tell that a lot of these new health technologies are not stress tested in real world environments."
"Our ultimate goal is to make sure that racial equity is embedded into every aspect of our design culture."
"Let’s have diverse co-creation from the beginning to reduce bias."
"Not every diverse population will have the same experiences; I don't have every black experience."
"The first step is to identify where and how we might be exclusionary."
"Raising awareness around dark metrics is essential for user advocacy."
More Videos
"You probably wanna hit the resume recording button."
Samuel ProulxInvisible barriers: Why accessible service design can’t be an afterthought
December 3, 2024
"Whenever we converse, there’s an opportunity for conversion."
Victor UdoewaTheme One Intro
March 27, 2023
"For us to report concluded that after 33 years of research investing in design practices have a direct impact on benefits."
Gonzalo GoyanesDesign ROI: Cover a Little, Get a Lot
September 8, 2022
"Ethical design can impact some harms, but not all."
Alexandra SchmidtWhy Ethics Can't Save Tech
November 18, 2022
"Users don't hire designers; businesses do."
Jose CoronadoFrom Zero to Hero
September 8, 2022
"All neurodiversity is unique and not one size fits all."
Pippa LomasPaving the Path for Neurodiversity in Design
October 4, 2023
"Your unique perspective can help crack open issues that deep specialists might overlook."
Louis Rosenfeld Matt Jones Olga Khroustaleva Michael Leggett Karol MunozDo you want to work on climate? (Climate UX Discussion Series)
November 15, 2023
"You can measure the success of your team by the behavior changes in your users."
Jeff GothelfThe Intersection of Lean and Design
January 10, 2019
"Once you get into the conversation, things are going to occur to you."
Dave GrayGroup Activity: Making Sense of DesignOps
November 7, 2017
