Who does the math: A designer’s journey in building an AI-based tutoring app
This video is featured in the Designing with AI 2025 playlist.
Summary
We built a novel math tutoring app for 11-year-olds in the UK. Since this was our first AI project, we expected lots of technical issues. Those happened and on top of it, we ended up questioning the value of designers in AI-driven products.
Key Insights
-
•
Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.
-
•
AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.
-
•
The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.
-
•
Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.
-
•
Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.
-
•
Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.
-
•
Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.
-
•
The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.
-
•
AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.
-
•
AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.
Notable Quotes
"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."
"We realized designing for AI is very different from other computational mediums we used before."
"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."
"With LLMs, precision is not possible; no one really knows why it decided what to say."
"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."
"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."
"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."
"AI companies focus on the shiniest thing that comes without caring about stability or reliability."
"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."
"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."
Or choose a question:
More Videos
"That mink showed up and it took on a fight that felt more enormous than it was."
Jemma AhmedResearch at an inflection point: Adapting to a new era of collaboration, equity, and innovation
March 11, 2025
"Dana is a reliable, solutions-oriented designer who prefers honest feedback but needs clear expectations."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"The assistant deputy minister described this to me as a design problem, even if his peers couldn’t articulate it that way."
Gordon Ross12 Months of COVID-19 Design and Digital Response with the British Columbia Government
December 8, 2021
"Nobody is going to be satisfied by insight-shaped answers or high-level summaries masquerading as breakthroughs."
Laura KleinHuman vs. machine: Testing AI’s ability to synthesize and analyze research
March 11, 2026
"Combining behavioral and attitudinal data helps us understand not just what users do, but how they feel about it."
Alberto FerreiraMaking it Count: Developing a custom digital metric framework that works
October 15, 2021
"You can see how this is an absolutely fantastic way to get any UX question answered quickly at any time of day without bothering your instructor or your boss."
Louis RosenfeldHow to use the Rosenbot
March 16, 2026
"AI tools generate convincing yet potentially misleading content at scale, eroding public trust."
Noah BondRedefining truth and inclusivity: Navigating data ownership and ethical research in the age of disinformation
March 11, 2025
"Job titles are a lagging indicator—it will take a while before the industry renames roles in line with actual work changes."
James LangHopeful Futures for UX Research
January 30, 2026
"Sustainability is a long haul; you have to stay stubborn and not take no for an answer in a bad way."
Amy ParnessScaling Sustainability: Complementary strategies that drive long-term success
May 29, 2025
