Who does the math: A designer’s journey in building an AI-based tutoring app
This video is featured in the Designing with AI 2025 playlist.
Summary
Key Insights
-
•
Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.
-
•
AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.
-
•
The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.
-
•
Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.
-
•
Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.
-
•
Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.
-
•
Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.
-
•
The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.
-
•
AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.
-
•
AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.
Notable Quotes
"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."
"We realized designing for AI is very different from other computational mediums we used before."
"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."
"With LLMs, precision is not possible; no one really knows why it decided what to say."
"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."
"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."
"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."
"AI companies focus on the shiniest thing that comes without caring about stability or reliability."
"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."
"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."
Or choose a question:
More Videos
"If you said are you creative, I’m gonna say hell yeah."
Dr. Karl JeffriesThe Science of Creativity for DesignOps
January 8, 2024
"I never want to walk into a review with my stakeholders at the SVP level and see something for the first time."
Amy MarquezINVEST: Discussion
June 15, 2018
"Building an internal research practice is critical for long-term value and integration of insights."
Steve Portigal Chris Chapo Kelly Goto Christian RohrerDiscussion
May 13, 2015
"Agency style staffing allows designers to bring learnings across multiple projects and grow through new challenges."
Alicia MootyDesign Staffing Models
September 30, 2021
"Puppetry lets you communicate like, I don’t like what you said, how come you said that to me."
Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt LaurenceThe Authentic UX Talent Show
January 8, 2024
"Junior team members don’t have to talk directly to executives; working effectively with peers can create grassroots buy-in."
Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne RogondinoTheme 1: Discussion
January 8, 2024
"Data entry is the enemy; automation is the key to making research repositories successful."
Sofia QuinteroThe Product Philosophy Behind EnjoyHQ
March 10, 2021
"The incentive structure at a big company is set up to reward people for entirely different stuff than innovation requires."
Laura KleinUnique challenges of innovation in enterprises
April 23, 2020
"Embedded squads build domain expertise but risk losing knowledge if someone leaves, while centralized teams help reduce duplicated effort."
Andrew MichaelBuilding a Product Insights Team
March 10, 2022
