Rosenverse
Who does the math: A designer’s journey in building an AI-based tutoring app

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Who does the math: A designer’s journey in building an AI-based tutoring app

Gold
Tuesday, June 10, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist.

Share the love for this talk
Who does the math: A designer’s journey in building an AI-based tutoring app
Speakers: Aras Bilgen
Link:

Summary

We built a novel math tutoring app for 11-year-olds in the UK. Since this was our first AI project, we expected lots of technical issues. Those happened and on top of it, we ended up questioning the value of designers in AI-driven products.

Key Insights

  • Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.

  • AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.

  • The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.

  • Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.

  • Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.

  • Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.

  • Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.

  • The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.

  • AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.

  • AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.

Notable Quotes

"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."

"We realized designing for AI is very different from other computational mediums we used before."

"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."

"With LLMs, precision is not possible; no one really knows why it decided what to say."

"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."

"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."

"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."

"AI companies focus on the shiniest thing that comes without caring about stability or reliability."

"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."

"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."

Ask the Rosenbot
Nidhi Singh Rathore
Embracing participation to unlock deeper truths in commercial research
2025 • Advancing Research 2025
Gold
John Cutler
The Alignment Trap
2023 • Design in Product 2023
Gold
Jennifer Strickland
Adopting a "Design By" Method
2021 • Civic Design 2021
Gold
Steve Portigal
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Jeff Gothelf
Who does what by how much?
2025 • Advancing Service Design 2025
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Lija Hogan
Doing more with more: Lessons from the Front Lines of Democratization
2022 • Advancing Research 2022
Gold
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Chris Govias
Perspectives on Civic Design
2021 • Civic Design Community
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Greg Nudelman
Designing Conversational Interfaces
2019 • Enterprise Community
Stephanie Wade
Building and Sustaining Design in Government
2021 • Civic Design 2021
Gold

More Videos

Sara Conklin

"Every job is a climate job. Wherever we are, the climate needs us to address it in our role."

Sara Conklin

A UXer’s 12-Month Journey from Climate Concern to Climate Credibility

June 26, 2025

Benjamin Real

"It’s basically impossible for the design team to work without the design ops team."

Benjamin Real

Showing the Value of DesignOps by Not Having a DesignOps Team

October 21, 2020

Lena Shenkarenko

"Every small action counts when it comes to sustainability in urban settings."

Lena Shenkarenko

Collaborative Wireframing for Creating Team Alignment and Shipping Better Products

October 21, 2020

Maria Taylor

"If knowledge is difficult to find or hard to use, then all the great information doesn’t really help anyone."

Maria Taylor

Knowledge is Power: Managing the Lifeblood of the Design Org

October 3, 2023

Liz Ebengo

"Knowing your positionality and having native speakers and culturally sensitive methods is vital for authentic data gathering."

Liz Ebengo

The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward

December 4, 2024

Roberta Dombrowski

"Stakeholders might say no to research involvement if the context and relevance aren’t clear, or the ask seems overwhelming."

Roberta Dombrowski Sam Duong Woloszynski

Making Research a Team Sport

March 11, 2022

Rikki Teeters

"When anyone can make anything very fast and cheap, the role of UX is evolving."

Rikki Teeters

Concept to code: Transforming ideas into functional products with Kiro

June 10, 2026

Saara Kamppari-Miller

"There are so many different definitions for what inclusion is and they are all correct."

Saara Kamppari-Miller

Theme Three Intro

September 9, 2022

Jorge Arango

"We think with things; our brain is part of us but we extend our cognition into our environments and tools."

Jorge Arango

The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)

April 5, 2024