Rosenverse

This video is only accessible to conference ticket holders.

Log in Create account

For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.

Contact Support if you are having any issues.

Designing AI-first products on top of a rapidly evolving technology
Conference ticket
Tuesday, June 10, 2025 • Designing with AI 2025
Share the love for this talk
Designing AI-first products on top of a rapidly evolving technology
Speakers: Peter Van Dijck
Link:

Summary

This talk addresses the distinct challenges of designing AI-first products when the foundational technology is advancing at an unprecedented pace. We will discuss the practical implications of this rapid evolution on the design process and share our insights into creating effective user experiences in such a dynamic environment.

Key Insights

  • AI technology is evolving faster than in previous tech booms such as the internet and mobile.

  • Building with AI requires a continuous reassessment of assumptions due to rapid advancements in model capabilities.

  • It is essential to build evaluation systems (evals) to measure the performance and suitability of AI applications over time.

  • Effective product design involves understanding both the technical capabilities of AI models and the emotional responses of users.

  • Cross-disciplinary teams are crucial for developing AI solutions because the field is still evolving and no clear patterns are established yet.

Notable Quotes

"We've been built, we started a company to build only AI products a few years ago."

"The model capabilities keep evolving very quickly."

"Do never assume that things won't get better."

"Always plan to build for the specific capability that we think it's gonna have in six months."

"If you're gonna do a project very tactically, plan for a lot of meetings."

"We've seen that people trust AI a lot because it just seems very confident."

"It's good to try to find the people that explain things well or that you like."

"You should get good at prompt engineering, but do that by just using AI a lot."

"The big trick is evals, but don't throw away watching users and having decent analytics."

More Videos

Sam Proulx

"When you design accessible experiences, you make things better for everyone."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Hugh Dubberly

"Our values in design are changing from seeking perfection to embracing 'good enough' for the moment."

Hugh Dubberly

Problems with Problems: Reconsidering the Frame of Designing as Problem-Solving

June 19, 2019

Joseph Meersman

"A well-run design critique requires both humility and activeness in listening."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Kim Fellman Cohen

"Our metrics increases were more than we estimated they would be."

Kim Fellman Cohen

Measuring the Designer Experience

October 23, 2019

Alastair Simpson

"Building great products is a team sport; you need to support one another."

Alastair Simpson

Debunking the Myths of Cross-Disciplinary Collaboration

October 24, 2019

Harry Max

"Prioritization is a powerful tool because fundamentally, innovation is a problem-solving process."

Harry Max

Priority Zero: Some Things are More Equal than Others

June 9, 2016

Sahibzada Mayed

"So much of the work of oppression is policing the imagination."

Sahibzada Mayed

The Politics of Radical Research: A Manifesto

March 27, 2023

Dr. Nikki Smith

"The only thing harder than figuring out what you're going to do is figuring out why you're doing it."

Dr. Nikki Smith

Research Strategy: Connecting Insights to Outcomes

March 12, 2025

Uday Gajendar

"Being trauma-informed is a journey; you never completely arrive, it's a continuous process of learning and adapting."

Uday Gajendar Rachael Dietkus, LCSW Dr. Dawn Emerick Dawn E. Shedrick, LCSW

Leading through the long tail of trauma

July 13, 2022