Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
Gold
Monday, October 2, 2023 • DesignOps Summit 2023
Share the love for this talk
Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
Speakers: Jay Bustamante
Link:

Summary

In the very realistic future of an AI-driven world, the responsible and ethical implementation of technology is paramount. In this session, we will dive into the crucial role of DesignOps practitioners in driving ethical AI practices. We'll tackle the challenge of ensuring AI systems align with user values, respect privacy, and avoid biases, while unleashing their potential for innovation. As a UX strategist and DesignOps practitioner, I understand the significance of integrating ethical considerations into AI development. I bring a unique perspective on how DesignOps can shape the future of AI by fostering responsible innovation. This session challenges the status quo by highlighting the intersection of DesignOps and ethics, advancing the conversation in our field and sparking thought-provoking discussions. Attendees will gain valuable insights into the role of DesignOps in navigating the ethical landscape of AI. They will learn practical strategies and best practices for integrating ethical frameworks into their AI development processes. By exploring real-world examples and case studies, attendees will be inspired to push the boundaries of responsible AI and make a positive impact in their organizations. Join me in this exciting session to chart the course for ethical AI, challenge conventional thinking, and explore the immense potential of DesignOps in driving responsible innovation.

Key Insights

  • AI tech debt compounds exponentially, making rushed releases far more damaging than traditional tech debt.

  • Faulty AI bias can cause severe real-world harm, like wrongful arrests illustrated by Robert Williams' story.

  • Design ops leaders must act as 'party planners' to ensure diverse, multidisciplinary teams are involved in AI development.

  • Multidisciplinary teams should include legal experts, machine learning engineers, UX researchers, domain experts, business analysts, data scientists, and ethicists.

  • AI datasets often inherit societal biases, as revealed by MidJourney’s predominantly white, stereotyped image outputs.

  • Key ethical AI questions include verifying data origins, bias testing, and ongoing monitoring mechanisms.

  • Ethical prototyping requires simulating AI behavior against varied user personas and challenging scenarios.

  • Ethical stress testing evaluates AI responses in morally complex situations, such as autonomous vehicle dilemmas.

  • AI must be iterated ethically and continuously to prevent degradation and incorporation of biased or untrusted inputs.

  • Advocating for inclusion and ethical data use requires persistent escalation, especially in engineering-led organizations.

Notable Quotes

"AI tech debt has compounding interest to it."

"Rushing to market with AI solutions can irreparably damage not only your product but your entire brand."

"We are the solution to preventing harmful AI outcomes like Robert's wrongful arrest."

"Your role is to ensure that the right people are at the party — a multidisciplinary team."

"MidJourney’s dataset reflects stereotyped images because it’s based on internet image results without specific instruction."

"It is not our job to know all the answers, but to make sure the right questions are asked."

"Ethical stress testing subjects AI to hypothetical morally challenging scenarios to ensure alignment with ethical norms."

"AI learns from the world, sometimes from untrusted sources, so it needs continual ethical iteration."

"You can’t put the toothpaste back in the tube once biased AI harms your brand or users."

"Embrace the role of party planner with your expertise to shape ethical AI innovation."

Ask the Rosenbot
Kim Fellman Cohen
Measuring the Designer Experience
2019 • DesignOps Summit 2019
Gold
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life
2022 • Enterprise Community
Taylor Jennings
Repository Retrospective: Learnings from Introducing a Central Place for UX Research
2022 • Advancing Research 2022
Gold
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Conference
Kristin Skinner
Theme 1 Intro
2021 • DesignOps Summit 2021
Gold
Jen Cardello
Standardizing Product Merits for Leaders, Designers, and Everyone
2018 • Enterprise Experience 2018
Gold
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold
John Maeda
About Design Organizations
2019 • DesignOps Community
Kate Kalcevich
Integrating Accessibility in DesignOps
2024 • DesignOps Summit 2024
Gold
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
2020 • Advancing Research Community
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Catherine Dubut
Bridging Physical and Digital Spaces: Approaches to Retail Service Design
2021 • Enterprise Community
Jodi Forlizzi
Design and AI innovation
2024 • Designing with AI 2024
Gold
Joshua Graves
We Need To Talk: Managing Ludicrous Requests at Work (Part 3 of 3)
2025 • Rosenfeld Community
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold

More Videos

Lada Gorlenko

"If they can do it, so can I – that’s the takeaway from these transformation stories."

Lada Gorlenko

Theme 1: Intro

January 8, 2024

Sam Proulx

"Confidence is crucial — nobody wants to lose money or receive a product they can’t use, so unclear or unlabeled controls cause people with disabilities to give up faster."

Sam Proulx

Online Shopping: Designing an Accessible Experience

November 29, 2023

Benjamin Real

"The C-suite often sees big change as resistance to change rather than needs for careful transition and impact understanding."

Benjamin Real

Showing the Value of DesignOps by Not Having a DesignOps Team

October 21, 2020

Steve Chaparro

"Simplicity rarely loses to complexity in the public square—it’s about meeting people where they are."

Steve Chaparro

Bringing Into Alignment Brand, Culture and Space

August 13, 2020

Sara Conklin

"Don’t cold reach out to people with ‘let’s connect’; instead, ask very specific questions about topics they care about."

Sara Conklin

A UXer’s 12-Month Journey from Climate Concern to Climate Credibility

June 26, 2025

Uday Gajendar

"Mergers and acquisitions require us to carefully avoid pitfalls when unifying user experiences."

Uday Gajendar

Theme 1: Introduction

June 9, 2021

Christian Bason

"The future of civic design is systemic, mission-driven, ethical, inclusive, and regenerative, considering all living things."

Christian Bason

Innovating With People: Unleashing the Potential of Civic Design

December 8, 2021

Erika Kincaid

"Sometimes it helps to have an ally who champions you and acts as a gatekeeper for design requests."

Erika Kincaid Brenna Heaps Jessica Tsukimura

Connecting the Dots: How to Foster Collaboration and Build a Strong Design Review Culture

June 8, 2022

Hugh Dubberly

"Horst Rittel introduced wicked problems to describe problems where consensus on definition is difficult, and calling them problems can be misleading—maybe they’re better called messes or tangles."

Hugh Dubberly

Problems with Problems: Reconsidering the Frame of Designing as Problem-Solving

June 19, 2019