Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Speakers: Raven Veal
Link:

Summary

Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.

Key Insights

  • Dark metrics focus on the negative impacts of digital health technologies.

  • Basic product metrics often ignore the user's holistic experience and needs.

  • Disempowerment occurs when technology impairs an individual's autonomy.

  • Exclusion can manifest through implicit biases in technology design.

  • Addiction in technology often leads to excessive use and unhealthy dependencies.

  • Distraction from digital technologies can hinder workflow and engagement in healthcare settings.

  • Designers should prioritize ethical frameworks to measure success.

  • Incorporating diverse perspectives helps identify unintended consequences early.

  • Ethical considerations in design should be part of the profit model in businesses.

  • Continuous evaluation and adjustment of metrics is crucial in tech design.

Notable Quotes

"A Pinterest is worth a thousand words."

"The measure of a man is what he does with power."

"Designing is about augmenting intelligence, not replacing it."

"The actual algorithm didn’t make explicit mention to race as a variable."

"I can tell that a lot of these new health technologies are not stress tested in real world environments."

"Our ultimate goal is to make sure that racial equity is embedded into every aspect of our design culture."

"Let’s have diverse co-creation from the beginning to reduce bias."

"Not every diverse population will have the same experiences; I don't have every black experience."

"The first step is to identify where and how we might be exclusionary."

"Raising awareness around dark metrics is essential for user advocacy."

Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group
Maria Skaaden
Continuous Design: One eye on the horizon and the other on the next wave
2018 • DesignOps Summit 2018
Gold
Louis Rosenfeld
Opening Remarks
2022 • Civic Design 2022
Gold
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Silke Bochat
5 Antifragile Strategies for a DesignOps 2.0
2024 • DesignOps Summit 2024
Gold
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Tanya Snook
Designing the team experience: Building culture through onboarding
2021 • Enterprise Community
Carol Smith
Operationalizing Responsible, Human-Centered AI
2023 • Enterprise UX 2023
Gold
Toby Haug
Discussion
2017 • Enterprise Experience 2017
Gold
Lisa Welchman
Cleaning Up Our Mess: Digital Governance for Designers
2018 • Enterprise Experience 2018
Gold
Ron Bronson
Design, Consequences & Everyday Life
2022 • Civic Design 2022
Gold
Daniel Orbach
Zero to One: Co-Creating Operating Models with your Team
2024 • DesignOps Summit 2024
Gold
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Carol Scott
Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices
2025 • Rosenfeld Community
Shazia Ali
Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Spencer L. A. Stultz
Why Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives
2023 • DesignOps Summit 2023
Gold

More Videos

Ed Mullen

"Public institutions need to continually earn trust by effectively responding to people's needs."

Ed Mullen

Designing the Unseen: Enabling Institutions to Build Public Trust

November 16, 2022

Peter Levin

"Cell phones were going to directly compete with personal computers and Intel should both accommodate this new communications medium and also adjust its strategy."

Peter Levin

Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility

March 25, 2024

Bria Alexander

"We have been meeting every month for a few years now."

Bria Alexander Benson Low Natalya Pemberton Stephanie Goldthorpe

OKRs—Helpful or Harmful?

January 20, 2022

Kate Koch

"One of the coolest things an operations team can have is building the tools that we need to enable growth at scale"

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Amy Marquez

"Building trust creates a lot of affinity between teams."

Amy Marquez

INVEST: Discussion

June 15, 2018

Brenna Fallon

"What you build matters, but what matters more is if you learn."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Brian Moss

"Thanks for taking the time to come along today."

Brian Moss

What Does it Mean to be a Resilient Research Team?

March 9, 2022

Adel Du Toit

"If you can't determine where you started, you can't measure how far you've come."

Adel Du Toit

Get Your CFO To Say: 'Our Strategic Goal is User Obsession'

June 10, 2022

Kate Koch

"We love to flex our superpowers, but we’re trying to use them for good and not evil."

Kate Koch Jean-Claire Fitschen

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 29, 2021