Rosenverse

This video is only accessible to conference ticket holders.

Log in Create account

For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.

Contact Support if you are having any issues.

Managing the Human Engagement Risks of AI
Conference ticket
Tuesday, June 10, 2025 • Designing with AI 2025
Share the love for this talk
Managing the Human Engagement Risks of AI
Speakers: Ovetta Sampson
Link:

Summary

AI is fast transforming the way companies operate and design products and services. New design practices like “vibe coding,” or “prompt engineering,” are accelerating product launches at speed and scale. But with the rush to market; how can teams maintain their commitment to human-centered design, minimize the risks to consumers and keep up with the increase in developer velocity? We showcase various tactics companies are using to manage the risk of implementing AI into their products while keeping their ever tightening GTM timelines.

Key Insights

  • Generative AI lacks cognitive abilities and operates primarily by recognizing patterns.

  • Understanding the historical development of AI helps contextualize its current implications.

  • Good UX design is even more critical in the age of AI, emphasizing the need for human-centered design.

  • There are inherent biases in both AI and human decision-making that need to be addressed in the design process.

  • Designing for AI requires understanding the dynamic interplay between machine and human agency.

  • Establishing robust feedback loops is essential for monitoring AI behavior and ensuring ethical outcomes.

  • Adversarial testing is crucial for identifying potential harms in AI systems before they are deployed.

  • Mindful AI considers human behavior and societal values in its design.

  • Documenting data provenance and ensuring transparency helps mitigate biases in AI models.

  • Engaging actively with AI technologies enhances UX designers' confidence and capability.

Notable Quotes

"Our industry is undergoing such a disruption with artificial intelligence."

"Generative AI is a souped up mad lib."

"The idea of an agnostic algorithm is a myth."

"If you are not designing intelligence systems, I really do ask you to think about this paradigm shift."

"Generative AI has no moral code."

"You have to do that for generative AI, just like you would for a toddler learning right from wrong."

"AI biases can affect human decision making profoundly."

"AI doesn't do well in nuance."

"You need to document your data shortcomings to understand potential model liabilities."

"The more that you engage with this technology, the better confidence you will have in designing for it."

Heidi Trost
To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity
2025 • Rosenfeld Community
Sarah Fathallah
Lessening the Research Burden on Vulnerable Communities
2020 • Advancing Research 2020
Gold
Nathan Curtis
Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough?
2019 • DesignOps Community
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Marc Fonteijn
Increase your confidence, influence, and impact (through a Professional Community)
2024 • Advancing Service Design 2024
Gold
Kristin Skinner
Opening Keynote: Org Design for Design Orgs
2017 • DesignOps Summit 2017
Gold
Joseph Williams
Unlocking impact and influence through inclusive hiring in research
2021 • Advancing Research Community
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold
Daniel J. Rosenberg
Designing with and for Artificial Intelligence
2022 • Enterprise Community
Ilana Lipsett
Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
2021 • Civic Design 2021
Gold
Rachael Dietkus, LCSW
AI: Passionate defenses and reasoned critique [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold

More Videos

Sarah Flamion

"Thinking in Systems by Dinele Meadows is crucial for tackling complex projects."

Sarah Flamion

Complex Problem? Add Clarity by Combining Research and Systems Thinking

March 31, 2020

Cornelius Rachieru

"If we're focused only on things like design systems, we're all about scaling simplistic, repeatable processes."

Cornelius Rachieru

Handling Complexity: Framing a Scale of Design

June 9, 2021

Benjamin Wiedmaier

"Budgets are tight for researchers, designers, and product folks alike."

Benjamin Wiedmaier Annie Mayfield

Redefining Toolkits: Unbundling to Create a Perfect Match

March 11, 2025

Jon Fukuda

"Innovation isn't just a buzzword in design ops."

Jon Fukuda

Theme 3 Intro

September 25, 2024

Sarah Brooks

"We can't predict the future, but we can learn how to think about the future systematically."

Sarah Brooks

Theme 3 Intro

December 10, 2021

Kavana Ramesh

"Even small adaptations can create an equitable learning space"

Kavana Ramesh

Meaningful inclusion: Practicing accessibility research with confidence

September 24, 2024

Theresa Marwah

"Data governance is not just about compliance; it’s about authenticity in our relationships with participants."

Theresa Marwah

How Atlassian is Operationalizing Respect in Research

February 27, 2020

Chris Geison

"The essence of strategy is what we’re saying no to."

Chris Geison

What is Research Strategy?

March 11, 2021

Adel Du Toit

"If we can strategically target where we need to focus, that's when you get your CFO behind the design organization."

Adel Du Toit

Get Your CFO To Say: 'Our Strategic Goal is User Obsession'

June 10, 2022