This video is only accessible to conference ticket holders.
Log in Create account
For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.
Contact Support if you are having any issues.
This video is featured in the AI and UX playlist.
Summary
Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.
Key Insights
-
•
AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.
-
•
Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.
-
•
Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.
-
•
Large language models excel more at parsing user intent than merely providing factual answers.
-
•
The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.
-
•
Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.
-
•
Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.
-
•
Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.
-
•
AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.
-
•
Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.
Notable Quotes
"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."
"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."
"We wanted to create personality in interfaces without pretending they are human."
"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."
"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."
"The prompt becomes part design spec, part requirement doc, and part programming language."
"Large language models are far better at figuring out what you mean than simply giving an answer."
"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."
"AI can transform accessibility by changing experiences to meet user needs in the moment."
"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."
Dig deeper—ask the Rosenbot:
More Videos
"DPM loneliness and siloing happen because of wearing too many hats and inheriting mismatched responsibilities."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
"The words we use should enable clear paths of understanding so recipients know their role, what to do next, and why both easily and quickly."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"If a problem keeps coming up, it’s usually the execution of the idea that’s failing, not the concept."
Erin WeigelUX Lessons from running more than 1,200 A/B Tests
July 10, 2024
"I was ready to capture this fatal flaw that this fellow had discovered. It was so horrible it made him sigh. But it wasn’t."
Susan Simon-DanielsWar Stories LIVE! Susan Simon-Daniels
March 30, 2020
"UX people do have research methods that fit into shorter product development cycles."
Noreen Whysel Katie SaindonShort Take #4: UX/Product Lessons from Your Industry Peers
December 6, 2022
"Links are first-class citizens in hypertext note-taking; connecting notes brings ideas to life and reveals new relationships."
Jorge ArangoExploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
April 19, 2024
"Governance isn’t the byproduct of a project; digital is a system you have to design and iterate continuously."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Active listening means actually implementing the feedback or suggestions given—not just hearing them."
Zariah CameronStreamlining an Inclusive Design Practice
October 3, 2023
"If your talk isn’t accepted, it doesn’t mean it’s bad—it might just not fit the program’s narrative arc or available slots."
Louis Rosenfeld Jemma Ahmed Christian Crumlish Uday Gajendar Chris GeisonCoffee with Lou #3: What Makes for a Successful UX Conference Presentation?
May 2, 2024
