Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Most AI projects fail. Somewhere between 50-90% of them, which is double the rate of more traditional tech projects. This Rosenverse Session will draw on years of Carnegie Mellon HCII research to dive into the five traps that AI projects can fall into, and then talk about what designers and project managers can do to avoid those traps. Including one startling finding: user-centered design alone isn’t enough.
Key Insights
-
•
AI is perceived as both a superpower and a replacement threat among practitioners.
-
•
Many organizations push AI solutions without a clear understanding of their potential value.
-
•
Often, AI projects fail due to a focus on unnecessary complexities rather than simpler, impactful solutions.
-
•
The majority of AI projects (50-80%) fail due to misalignment between technical feasibility and user needs.
-
•
Companies frequently hunt for AI innovations in the wrong areas, overlooking high-value opportunities.
-
•
AI can perform well even with moderate accuracy, countering the misconception that perfection is necessary for value.
-
•
User-centered design may not effectively identify suitable problems for AI solutions, leading to misguided efforts.
-
•
The design for AI ecosystem needs a combination of user needs and AI capabilities to increase success rates of projects.
-
•
Ethical considerations must be integrated at every stage of AI development to avoid disastrous outcomes.
-
•
The newly proposed AI design framework encourages matching AI capabilities with user needs to enhance project outcomes.
Notable Quotes
"I'm an assistant professor of the practice, which means that I bring research from academics to the professional world and vice versa."
"AI can be this magical thing, but it's also just not that smart."
"Companies are really hunting in the wrong place for AI innovation."
"Just because you can do something doesn't mean that anyone wants it."
"AI projects fail due to poor data that is unavailable or biased."
"The AI innovation gap is a reason that firms overlook many builtable and desirable AI projects."
"You can start to think about how to find really good projects for narrow AI by scaling down the expertise necessary to the task."
"The history of design is the history of materials, and AI is just a new material for us to work with."
"AI struggles with context, taste, and common sense, and we as designers can provide these."
"AI is perceived as the shiny, sparkly thing while many undervalue the practical applications that truly address user needs."
















More Videos

"Don't try to solve for the system, try to understand the request."
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018

"Every time we communicate, we are indeed sharing a basic need for human connection."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024

"Research can help you identify meaningful metrics."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022

"The conference would not be as beautiful without her."
Bria AlexanderDay 3 Welcome
September 25, 2024

"If you have really good ideation techniques built into your design process, you can save a lot of time later on and a lot of headaches."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022

"Don’t underestimate the power of storytelling in conveying users’ needs to stakeholders."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021

"The values we uphold guide how we experience and influence team dynamics."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022

"The best practitioners see a biased view of their community's ability."
Adrian HowardSturgeon’s Biases
September 25, 2024

"Our work can't be evaluated in the same way that engineering work can."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023