Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Why AI projects fail (and what we can do about it)
Wednesday, May 14, 2025 • Rosenfeld Community
Share the love for this talk
Why AI projects fail (and what we can do about it)
Speakers: Dan Saffer
Link:

Summary

Most AI projects fail. Somewhere between 50-90% of them, which is double the rate of more traditional tech projects. This Rosenverse Session will draw on years of Carnegie Mellon HCII research to dive into the five traps that AI projects can fall into, and then talk about what designers and project managers can do to avoid those traps. Including one startling finding: user-centered design alone isn’t enough.

Key Insights

  • Most AI projects fail due to choosing the wrong problems rather than poor execution.

  • The AI innovation gap occurs because data scientists focus on technically hard but low-value problems.

  • User-centered design alone often identifies problems unsuitable for AI solutions.

  • AI works best for low-risk, moderate accuracy (~90%), narrow tasks like spam filtering or smart text suggestions.

  • Executives push AI fast to avoid falling behind, risking deployments without clear user or business value.

  • Consequences scanning is a vital method to detect and mitigate ethical risks before AI product launch.

  • Matchmaking AI capabilities with real user needs and organizational goals increases project success.

  • Agents add new AI capabilities to sense, think, and act, requiring adapted design processes.

  • AI lacks context, aesthetic taste, and common sense—designers must provide these to create effective AI products.

  • There is currently little corporate or legal accountability for AI ethics; responsibility largely falls to product teams.

Notable Quotes

"Welcome to the AI party, we've got 10 years of research to share."

"Executives said it's better to go fast and fail than to go slow and succeed."

"AI can be magical, but it's also just not that smart."

"Don Norman was named the top accomplished woman in UX by AI, even though Don is a man."

"Companies hunt for AI innovation in technically challenging areas instead of simpler, more valuable places."

"Most AI fails because projects require near perfect accuracy, which AI can't reliably deliver."

"The traditional user-centered design process doesn't work well for AI problems."

"Matchmaking connects AI capabilities to user needs so you find the low hanging fruit projects."

"AI struggles with context, taste, and common sense, and designers bring that to the table."

"Consequences scanning helps detect unintended harms and risks before launching AI features."

Ask the Rosenbot
Megan Nipe
Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging
2021 • Civic Design 2021
Gold
Natalia Radywyl
Co-Designing New Power in Australia's Public Sector
2022 • Civic Design 2022
Gold
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Joseph Williams
Unlocking impact and influence through inclusive hiring in research
2021 • Advancing Research Community
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Advancing Research Community
Nathan Shedroff
Redefining Value: Bridging the Innovation Culture Divide
2015 • Enterprise UX 2015
Gold
Ariel Kennan
Theme Two Intro
2022 • Civic Design 2022
Gold
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group
Greg Petroff
Everything is About to Change: Software as Material
2016 • Enterprise UX 2016
Gold
Peter Merholz
Customer-Centered Design Organizations
2017 • Enterprise Experience 2017
Gold
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
Jim Kalbach
Peace is waged with sticky notes: Mapping Real-World Experiences
2018 • Enterprise Experience 2018
Gold

More Videos

George Aye

"Not every project needs to be responded to; not every RFP needs a proposal."

George Aye

That Quiet Little Voice: When Design and Ethics Collide

November 16, 2022

Xenia Adjoubei

"Data sovereignty is about who owns your data, which country’s laws apply, and how vulnerable groups are fairly protected."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Benjamin Wiedmaier

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

Benjamin Wiedmaier Annie Mayfield

Redefining Toolkits: Unbundling to Create a Perfect Match

March 11, 2025

John Devanney

"Not every head of design is the right leader for every phase of organizational maturity."

John Devanney

The Design Management Office

November 6, 2017

Steve Sanderson

"Just because you've been right in the past doesn't guarantee you'll be right in the future."

Steve Sanderson Alissa Briggs Jeff Gothelf Bill Scott

Discussion

May 14, 2015

Jemma Ahmed

"Jackie Ho talks about how to keep teams accountable and aligned while maintaining their autonomy."

Jemma Ahmed

Theme 2 Intro

January 8, 2024

Megan Kierstead

"Thoughts cause feelings, and feelings motivate actions. Changing thoughts changes everything."

Megan Kierstead

You Are a Badass at UX: Overcoming Imposter Syndrome

March 10, 2021

PJ Buddhari

"Spectrum is about empowering collaboration across products, disciplines, and clouds — not just providing tools but supporting people using the system."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

James Lang

"The ethics in community design are critical — emotional damage can be severe if mishandled."

James Lang

If you can design an app, you can design a community

May 22, 2025