Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Most AI projects fail. Somewhere between 50-90% of them, which is double the rate of more traditional tech projects. This Rosenverse Session will draw on years of Carnegie Mellon HCII research to dive into the five traps that AI projects can fall into, and then talk about what designers and project managers can do to avoid those traps. Including one startling finding: user-centered design alone isn’t enough.
Key Insights
-
•
Most AI projects fail due to choosing the wrong problems rather than poor execution.
-
•
The AI innovation gap occurs because data scientists focus on technically hard but low-value problems.
-
•
User-centered design alone often identifies problems unsuitable for AI solutions.
-
•
AI works best for low-risk, moderate accuracy (~90%), narrow tasks like spam filtering or smart text suggestions.
-
•
Executives push AI fast to avoid falling behind, risking deployments without clear user or business value.
-
•
Consequences scanning is a vital method to detect and mitigate ethical risks before AI product launch.
-
•
Matchmaking AI capabilities with real user needs and organizational goals increases project success.
-
•
Agents add new AI capabilities to sense, think, and act, requiring adapted design processes.
-
•
AI lacks context, aesthetic taste, and common sense—designers must provide these to create effective AI products.
-
•
There is currently little corporate or legal accountability for AI ethics; responsibility largely falls to product teams.
Notable Quotes
"Welcome to the AI party, we've got 10 years of research to share."
"Executives said it's better to go fast and fail than to go slow and succeed."
"AI can be magical, but it's also just not that smart."
"Don Norman was named the top accomplished woman in UX by AI, even though Don is a man."
"Companies hunt for AI innovation in technically challenging areas instead of simpler, more valuable places."
"Most AI fails because projects require near perfect accuracy, which AI can't reliably deliver."
"The traditional user-centered design process doesn't work well for AI problems."
"Matchmaking connects AI capabilities to user needs so you find the low hanging fruit projects."
"AI struggles with context, taste, and common sense, and designers bring that to the table."
"Consequences scanning helps detect unintended harms and risks before launching AI features."
Or choose a question:
More Videos
"Meditation isn’t about stopping thinking, it’s about becoming aware of thinking."
Mary-Lynne WilliamsExit Interview #4: From Product Design Leadership to Sound Healing
January 14, 2026
"Wizard of Oz testing involves someone pretending to be a screen reader by reading content and roles out loud."
Elana Chapman Li Wen Huang Divyen Sanganee Annabel WeinerGetting started with accessibility research
February 20, 2025
"This header took six minutes of IA work—but two years to make happen."
Sarah BarrettThe "How" of Enterprise Information Architecture
June 6, 2023
"True success means designing teams for resilience so they’re ready for whatever season comes."
Mariesa LenzWhat Beekeeping Taught me about Product Teams
October 29, 2025
"Research is at a critical moment as relational dynamics between participants, organizations, and researchers shift from linear to plural and relational."
Jemma Ahmed Megan Blocker Eduardo OrtizRedefining the research toolkit: Expanding methodologies for a changing world
March 12, 2025
"Designing community is more like gardening than building a machine."
James LangIf you can design an app, you can design a community
May 22, 2025
"Ops-first means standardizing processes so we can scale and onboard new team members quickly."
Clemens Janssen Jane DavisEfficiently Scaling Research as a Team of One
March 28, 2023
"Now everyone’s an edge case, so research needs to focus on those edge cases, not just the average user."
Lija Hogan Milan Mijatovic Sam Proulx Louis RosenfeldThree Years Out: Perspectives on the Near-Term Future of User Research
March 15, 2024
"Sharing is actually the end—it’s basically the last step that means you’ve completed your study or analysis."
Etienne FangPower of Insights: Why sharing is better than silos with Uber’s Insights Platform
December 16, 2019
