This video is only accessible to conference ticket holders.
Log in Create account
For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.
Contact Support if you are having any issues.
Summary
We built a novel math tutoring app for 11-year-olds in the UK. Since this was our first AI project, we expected lots of technical issues. Those happened and on top of it, we ended up questioning the value of designers in AI-driven products.
Key Insights
-
•
Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.
-
•
AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.
-
•
The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.
-
•
Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.
-
•
Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.
-
•
Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.
-
•
Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.
-
•
The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.
-
•
AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.
-
•
AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.
Notable Quotes
"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."
"We realized designing for AI is very different from other computational mediums we used before."
"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."
"With LLMs, precision is not possible; no one really knows why it decided what to say."
"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."
"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."
"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."
"AI companies focus on the shiniest thing that comes without caring about stability or reliability."
"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."
"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."
Dig deeper—ask the Rosenbot:
More Videos
"Be human first when creating new roles; treat them with the same care as hiring new team members."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
"Social pain affects the nervous system in the exact same way as physical pain."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"No tracking is perfect because numbers tell you what likely happened, but not why it happened."
Erin WeigelUX Lessons from running more than 1,200 A/B Tests
July 10, 2024
"Never assume and always ask why."
Susan Simon-DanielsWar Stories LIVE! Susan Simon-Daniels
March 30, 2020
"Some bias against human-centered UX comes from concern that ordinary folks don't understand technical software requirements."
Noreen Whysel Katie SaindonShort Take #4: UX/Product Lessons from Your Industry Peers
December 6, 2022
"Knowledge gardening requires continuous nurturing — revisiting notes, expanding them over time, not just capturing and forgetting."
Jorge ArangoExploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
April 19, 2024
"You can’t expect people to comply with standards if you don’t know who they are."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"It’s not just about the customer experience but also the employee experience, and they must coincide."
Zariah CameronStreamlining an Inclusive Design Practice
October 3, 2023
"Newness isn’t necessarily a new methodology—it can be a new way of looking at something familiar."
Louis Rosenfeld Jemma Ahmed Christian Crumlish Uday Gajendar Chris GeisonCoffee with Lou #3: What Makes for a Successful UX Conference Presentation?
May 2, 2024
