This video is only accessible to conference ticket holders.
Log in Create account
For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.
Contact Support if you are having any issues.
Summary
This talk addresses the distinct challenges of designing AI-first products when the foundational technology is advancing at an unprecedented pace. We will discuss the practical implications of this rapid evolution on the design process and share our insights into creating effective user experiences in such a dynamic environment.
Key Insights
-
•
AI technology is evolving faster than in previous tech booms such as the internet and mobile.
-
•
Building with AI requires a continuous reassessment of assumptions due to rapid advancements in model capabilities.
-
•
It is essential to build evaluation systems (evals) to measure the performance and suitability of AI applications over time.
-
•
Effective product design involves understanding both the technical capabilities of AI models and the emotional responses of users.
-
•
Cross-disciplinary teams are crucial for developing AI solutions because the field is still evolving and no clear patterns are established yet.
Notable Quotes
"We've been built, we started a company to build only AI products a few years ago."
"The model capabilities keep evolving very quickly."
"Do never assume that things won't get better."
"Always plan to build for the specific capability that we think it's gonna have in six months."
"If you're gonna do a project very tactically, plan for a lot of meetings."
"We've seen that people trust AI a lot because it just seems very confident."
"It's good to try to find the people that explain things well or that you like."
"You should get good at prompt engineering, but do that by just using AI a lot."
"The big trick is evals, but don't throw away watching users and having decent analytics."
















More Videos

"When you design accessible experiences, you make things better for everyone."
Sam ProulxOnline Shopping: Designing an Accessible Experience
June 7, 2023

"Our values in design are changing from seeking perfection to embracing 'good enough' for the moment."
Hugh DubberlyProblems with Problems: Reconsidering the Frame of Designing as Problem-Solving
June 19, 2019

"A well-run design critique requires both humility and activeness in listening."
Joseph MeersmanSweating the Pixel: Scaling Quality through Critique
June 10, 2021

"Our metrics increases were more than we estimated they would be."
Kim Fellman CohenMeasuring the Designer Experience
October 23, 2019

"Building great products is a team sport; you need to support one another."
Alastair SimpsonDebunking the Myths of Cross-Disciplinary Collaboration
October 24, 2019

"Prioritization is a powerful tool because fundamentally, innovation is a problem-solving process."
Harry MaxPriority Zero: Some Things are More Equal than Others
June 9, 2016

"So much of the work of oppression is policing the imagination."
Sahibzada MayedThe Politics of Radical Research: A Manifesto
March 27, 2023

"The only thing harder than figuring out what you're going to do is figuring out why you're doing it."
Dr. Nikki SmithResearch Strategy: Connecting Insights to Outcomes
March 12, 2025

"Being trauma-informed is a journey; you never completely arrive, it's a continuous process of learning and adapting."
Uday Gajendar Rachael Dietkus, LCSW Dr. Dawn Emerick Dawn E. Shedrick, LCSWLeading through the long tail of trauma
July 13, 2022