This video is featured in the AI and UX playlist.
Summary
This talk addresses the distinct challenges of designing AI-first products when the foundational technology is advancing at an unprecedented pace. We will discuss the practical implications of this rapid evolution on the design process and share our insights into creating effective user experiences in such a dynamic environment.
Key Insights
-
•
AI models evolve faster than previous tech revolutions, requiring adaptive product development.
-
•
Effective AI products use evals—automated tests on real data—to continuously measure quality.
-
•
Retrieval augmented generation and tool use are practical architectural tricks to reduce AI hallucination.
-
•
AI experiences must account for user trust despite AI’s confident but sometimes inaccurate outputs.
-
•
Human factors like worker anxiety about job security are critical to address in AI adoption.
-
•
Cross-disciplinary teams are essential in AI design due to the space’s novelty and uncertainty.
-
•
Prompt engineering skills grow best through extensive real use rather than frozen techniques.
-
•
Planning AI products with expectations of improved capabilities 6-9 months ahead optimizes outcomes.
-
•
Cultural acceptance of AI use inside organizations must be actively encouraged to avoid user hiding.
-
•
User testing of AI products still requires old-school observation combined with analytics and evals.
Notable Quotes
"You can’t have good AI without good information architecture."
"Everything’s changing really quickly—if you don’t revise your plan in a few months, you’re building for a world that’s already outdated."
"Hallucinations are when AI makes up stuff—it's a fundamental property of these models."
"Retrieval augmented generation is just adding results from a search into the model’s context to make it more grounded."
"Agents are models using tools in the loop, calling normal software functions as part of their process."
"People tend to trust AI a lot because it seems very confident—even when it’s not always accurate."
"Workers are often worried about layoffs and their value when AI speeds up their process, while executives like the efficiency gains."
"You should get good at prompt engineering by using AI a lot, not by memorizing outdated tricks."
"Building evals is like building tests to know if your AI system is good enough, and you can rerun them as models improve."
"User testing for AI still means watching people use it, plus collecting analytics and running evaluations."
Or choose a question:
More Videos
"When fellow co-workers label an individual as difficult, it's hard not to treat that individual as a problem."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
"Government isn’t always trusted, so we worked with local partners to connect with underserved communities."
Aaron Stienstra Lashanda HodgeLeveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
December 8, 2021
"Watching users navigate with assistive technology exposes you to barriers that people with disabilities face online."
Kavana RameshMeaningful inclusion: Practicing accessibility research with confidence
September 24, 2024
"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."
Helen ArmstrongAugment the Human. Interrogate the System.
June 7, 2023
"More math is coming our way into research into UX."
Scott PlewesWhy Isn't Your UX Approach Going Viral?: A Mathematical Model
March 28, 2023
"Empathy in design has been too focused on people and often on standardized personas rather than true diversity and marginalized voices."
Christian BasonExpand—Rethinking Design for Public Challenges
September 14, 2022
"You never start AI product design from the technology itself; you start from the user outcomes and retro-engineer the needed context."
Peter Van DijckBuilding impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!
July 30, 2025
"Semiotics isn’t just words and pictures; it includes every stimulus in your waking and even perhaps sleeping life."
Soma Ghosh Savina Hawkins Dave Hoffer Rob Thomas Victor UdoewaWhat emerging methods are advancing UX research [Advancing Research Community Workshop Series]
September 28, 2023
"As soon as I started writing stories down, more memories came back from all over my research career."
Steve Portigal Susan Simon-Daniels Tamara Hale Randolph Duke IIWar Stories LIVE! Q&A-Discussion
March 30, 2020
