This video is featured in the AI and UX playlist.
Summary
This talk addresses the distinct challenges of designing AI-first products when the foundational technology is advancing at an unprecedented pace. We will discuss the practical implications of this rapid evolution on the design process and share our insights into creating effective user experiences in such a dynamic environment.
Key Insights
-
•
AI models evolve faster than previous tech revolutions, requiring adaptive product development.
-
•
Effective AI products use evals—automated tests on real data—to continuously measure quality.
-
•
Retrieval augmented generation and tool use are practical architectural tricks to reduce AI hallucination.
-
•
AI experiences must account for user trust despite AI’s confident but sometimes inaccurate outputs.
-
•
Human factors like worker anxiety about job security are critical to address in AI adoption.
-
•
Cross-disciplinary teams are essential in AI design due to the space’s novelty and uncertainty.
-
•
Prompt engineering skills grow best through extensive real use rather than frozen techniques.
-
•
Planning AI products with expectations of improved capabilities 6-9 months ahead optimizes outcomes.
-
•
Cultural acceptance of AI use inside organizations must be actively encouraged to avoid user hiding.
-
•
User testing of AI products still requires old-school observation combined with analytics and evals.
Notable Quotes
"You can’t have good AI without good information architecture."
"Everything’s changing really quickly—if you don’t revise your plan in a few months, you’re building for a world that’s already outdated."
"Hallucinations are when AI makes up stuff—it's a fundamental property of these models."
"Retrieval augmented generation is just adding results from a search into the model’s context to make it more grounded."
"Agents are models using tools in the loop, calling normal software functions as part of their process."
"People tend to trust AI a lot because it seems very confident—even when it’s not always accurate."
"Workers are often worried about layoffs and their value when AI speeds up their process, while executives like the efficiency gains."
"You should get good at prompt engineering by using AI a lot, not by memorizing outdated tricks."
"Building evals is like building tests to know if your AI system is good enough, and you can rerun them as models improve."
"User testing for AI still means watching people use it, plus collecting analytics and running evaluations."
Or choose a question:
More Videos
"Most categories are fuzzy; there’s no clear boundary between what’s in or out."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"You need maniacal focus to prioritize, but remain flexible as priorities will always change."
Maria GiudiceBecoming a Changemaker by Leading with Design
March 29, 2023
"I desperately needed a specifically Black centered ethos of design to avoid being a pair of hands contributing to imperialistic white supremacist capitalist patriarchy."
Florence OkoyeAfroFuturism and UX Research
March 27, 2023
"Having the researcher in the room throughout the product lifecycle is super helpful."
Anna AvrekhUser Research, Design, and Product - A Love Story
March 11, 2021
"Early touchscreen technology was considered useless and suffered from gorilla arm fatigue."
Samuel ProulxDesigning for Disability, Innovating for Everyone
March 11, 2025
"Post-its give everyone an equal playing field, preventing dominant voices from overshadowing others in community conversations."
Justin Entzminger Terrance Smith Tracy M. Colunga Mai-Ling GarciaRisk and Reward: How to Diversify the Field of Civic Innovators and Designers
November 17, 2022
"If you work with humans, you work with trauma; it’s inherent in human experience."
Uday Gajendar Rachael Dietkus, LCSW Dr. Dawn Emerick Dawn E. Shedrick, LCSWLeading through the long tail of trauma
July 7, 2022
"Nearly three quarters of those surviving violent trauma report alcohol use disorders, which can lead to thoughts of suicide."
Megan Nipe Lyndsay BoothHuman-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging
December 8, 2021
"Creative collaborations often yield the best results, so don't shy away from being inventive in building your research Ops practice."
Noel LambCultivating Business Partnerships to Grow Research Ops
March 21, 2022
Latest Books All books
Dig deeper with the Rosenbot
In what ways can organizations use scaffolding to overcome bureaucratic constraints in service design?
How can ethnographic storytelling contribute to making systems visible in organizations?
How can small teams apply service design to navigate shifting conditions without multi-year strategic plans?