Moving AI offscreen: Exploring failures, constraints, and recovery in physical game design
This video is featured in the AI Conference playlist.
Summary
Key Insights
-
•
AI compresses years of training and enables access to unfamiliar design domains rather than replacing expertise.
-
•
Providing AI with rich contextual information via voice input improves output relevance significantly compared to short typed prompts.
-
•
Validating concepts cheaply with basic physical prototypes before investing in hardware avoids wasting resources.
-
•
AI can generate usable 3D design files and even scripting code to create printable models, accelerating prototyping.
-
•
Iterative back-and-forth with AI to refine outputs is a critical skill, not a single-prompt solution.
-
•
AI-generated solutions may work once but can fail in variable real-world conditions, necessitating user testing.
-
•
Physical hardware design forces more rigorous consideration of edge cases compared to software alone.
-
•
Tools like Adafruit's Circuit Playground Express enable physical inputs to simulate keyboard presses in software easily.
-
•
Scaling 3D prints requires adjusting slicer settings manually, a complexity AI cannot yet fully solve.
-
•
AI opens the door for creators to realize ideas they thought were out of reach, even without formal expertise.
Notable Quotes
"AI is not going to make you an expert but it compresses access to previously inaccessible domains."
"Don’t type with AI, talk to it like a brilliant colleague who knows nothing about your project yet—give it everything."
"Working with AI is a back and forth negotiation, not a vending machine where one prompt gets you the answer."
"The lesson isn’t that AI was wrong, but that you still have to test it against your users."
"I am not a hardware engineer, but I made something requiring those skills because AI gave me access to the doorway."
"In physical design, edge cases are more visible and testing immediately shows you problems you might have missed in software."
"AI can generate 3D models and geometry files, which you can directly import and print after careful checking."
"When scaling up 3D prints, slicer settings have to be adjusted—something AI didn’t help me with."
"A feature that only works some of the time is a feature that fails publicly in a walk-up installation."
"You don’t have to build a game; maybe you want to build a toy for your cat or a lamp—it just has to be yours."
Or choose a question:
More Videos
"Most AI fails because projects require near perfect accuracy, which AI can't reliably deliver."
Dan SafferWhy AI projects fail (and what we can do about it)
May 14, 2025
"Your job is not producing assets; it’s usually some other kind of process. If it’s only about assets, find a better job."
Tom Armitage Carla Diana Kanene Ayo HolderDay 2 Panel: Looking ahead: Designing with AI in 2026
June 11, 2025
"Nearly half of adults in the UK read at a literacy level that makes understanding complex documents very challenging."
Phil HeskethDesigning Accessible Research Workflows
September 29, 2021
"Framing research as a way for us to work collaboratively and solve problems from its department, not just the UX or design team."
Jemma Ahmed Chris GeisonBridge Building across Research Disciplines
August 26, 2021
"Remote, unmoderated usability studies give designers feedback in less than a day."
Marjorie Stainback Kelsey KingmanTransforming Strategic Research Capacity through Democratization
October 24, 2019
"Diary studies are fantastic when you're looking at growing a team and onboarding new people."
Holly ColeUnderstanding Experiences: When you have to do more than work
November 8, 2018
"Human-centered design is not just about your end users, it’s about the humans in your team."
Gretchen AndersonScaling the Human Center
June 8, 2017
"You should never be engaging lived experts without compensating them for their time."
Samuel MartinCo-Design vs Faux-Design: Navigating the Complexities of Sharing Power in Co-Design
March 27, 2026
"Scale is social work because it’s about creating relationships and reducing friction."
Jacqui FreyScale is Social Work
March 19, 2020
