Rosenverse

This video is only accessible to conference ticket holders.

Log in Create account

For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.

Contact Support if you are having any issues.

Managing the Human Engagement Risks of AI
Conference ticket
Tuesday, June 10, 2025 • Designing with AI 2025
Share the love for this talk
Managing the Human Engagement Risks of AI
Speakers: Ovetta Sampson
Link:

Summary

AI is fast transforming the way companies operate and design products and services. New design practices like “vibe coding,” or “prompt engineering,” are accelerating product launches at speed and scale. But with the rush to market; how can teams maintain their commitment to human-centered design, minimize the risks to consumers and keep up with the increase in developer velocity? We showcase various tactics companies are using to manage the risk of implementing AI into their products while keeping their ever tightening GTM timelines.

Key Insights

  • Generative AI lacks cognitive abilities and operates primarily by recognizing patterns.

  • Understanding the historical development of AI helps contextualize its current implications.

  • Good UX design is even more critical in the age of AI, emphasizing the need for human-centered design.

  • There are inherent biases in both AI and human decision-making that need to be addressed in the design process.

  • Designing for AI requires understanding the dynamic interplay between machine and human agency.

  • Establishing robust feedback loops is essential for monitoring AI behavior and ensuring ethical outcomes.

  • Adversarial testing is crucial for identifying potential harms in AI systems before they are deployed.

  • Mindful AI considers human behavior and societal values in its design.

  • Documenting data provenance and ensuring transparency helps mitigate biases in AI models.

  • Engaging actively with AI technologies enhances UX designers' confidence and capability.

Notable Quotes

"Our industry is undergoing such a disruption with artificial intelligence."

"Generative AI is a souped up mad lib."

"The idea of an agnostic algorithm is a myth."

"If you are not designing intelligence systems, I really do ask you to think about this paradigm shift."

"Generative AI has no moral code."

"You have to do that for generative AI, just like you would for a toddler learning right from wrong."

"AI biases can affect human decision making profoundly."

"AI doesn't do well in nuance."

"You need to document your data shortcomings to understand potential model liabilities."

"The more that you engage with this technology, the better confidence you will have in designing for it."

More Videos

Johanna Kollmann

"The product leadership doesn't see the value in research and they're thinking about shutting the research team down."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

Louis Rosenfeld

"If you have been to all four conferences, why don't you go ahead and say so in the chat window?"

Louis Rosenfeld Bria Alexander

Opening Remarks

March 27, 2023

Ian Swinson

"Your career is the only design project you'll ever own."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Jamika Burge

"We should be pushing for clarity and understanding of the policies that train AI models."

Jamika Burge

Embracing change: Navigating shifting landscapes with compassion and agency

March 11, 2025

Sam Proulx

"In today's world, accessibility is built into major browsers and operating systems."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

June 10, 2022

Kristin Wisnewski

"We’ve learned to always be testing versus always be guessing."

Kristin Wisnewski

Measuring What Matters

October 23, 2019

Liz Ebengo

"Redemption is an economic term that means to buy back something or someone to restore it to its rightful place."

Liz Ebengo

The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward

December 4, 2024

Dr. Nikki Smith

"Knowing where you stand is the beginning of all wisdom."

Dr. Nikki Smith

Research Strategy: Connecting Insights to Outcomes

March 12, 2025

Nora Tejeda

"We realized developers were doing design tasks without a structured approach, which raised concerns."

Nora Tejeda Giovanna Alonso

Scaling Design Capabilities at BBVA Through a Self-service Design Model

June 10, 2021