Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Sentient Scenes and Radically Adaptive Experiences

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist and 2 more.

Share the love for this talk
Sentient Scenes and Radically Adaptive Experiences
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.

Key Insights

  • AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.

  • Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.

  • Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.

  • Large language models excel more at parsing user intent than merely providing factual answers.

  • The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.

  • Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.

  • Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.

  • Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.

  • AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.

  • Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.

Notable Quotes

"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."

"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."

"We wanted to create personality in interfaces without pretending they are human."

"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."

"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."

"The prompt becomes part design spec, part requirement doc, and part programming language."

"Large language models are far better at figuring out what you mean than simply giving an answer."

"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."

"AI can transform accessibility by changing experiences to meet user needs in the moment."

"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."

Ask the Rosenbot
Peter Merholz
Customer-Centered Design Organizations
2017 • Enterprise Experience 2017
Gold
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Maria Rosala
Research Repositories
2026 • Advancing Research 2026
Conference
Jon Fukuda
Theme 3 Intro
2024 • DesignOps Summit 2024
Gold
Ivana Ng
Level Up Your Program with ProductOps
2024 • Enterprise Experience 2020
Gold
Nathan Reiff
Research, from Unimaginable to Presently Possible: A Future-Casting Sticky-Note Sprint
2026 • Advancing Research 2026
Conference
Louis Rosenfeld
The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
2024 • Designing with AI 2024
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Weidan Li
Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
George Abraham
Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
2021 • DesignOps Summit 2021
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
Nathan Curtis
Discussion
2016 • Enterprise UX 2016
Gold
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold

More Videos

Chris Geison

"I present myself as simply somebody who’s on this journey to figure it out."

Chris Geison Cristen Torrey Eric Mahlstedt

What is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question

March 4, 2021

Steve Baty

"The empathy in defending the opposing team’s idea is very, very powerful and helps find a third way in deadlocked conflicts."

Steve Baty Richard Dalton Maria Giudice Harry Max

Discussion

June 9, 2016

Louis Rosenfeld

"Put feelings into the data by talking to sales and after sales, understanding customer experience before and after product launches."

Louis Rosenfeld Jose Coronado Rachel Posman Guneet Singh Crystal Yan

The Bigger Picture: A Panel Discussion

October 23, 2019

Kristin Skinner

"We're seeing a shift towards impact and how we measure success in the experience itself."

Kristin Skinner

Theme 1 Intro

September 29, 2021

George Hinchliffe

"Our design system and components are public on developer.servicenow.com to encourage customer reuse and consistency."

George Hinchliffe Joy Liu

Delivering Amazing Experiences

June 10, 2021

Louis Rosenfeld

"Every job really is a climate job—there are ways to bring climate focus into any role."

Louis Rosenfeld Matt Jones Olga Khroustaleva Michael Leggett Karol Munoz

Do you want to work on climate? (Climate UX Discussion Series)

November 15, 2023

Dr Chloe Sharp

"A high-level roadmap with now, next, later helped us show we had a plan but kept flexibility for changing priorities."

Dr Chloe Sharp

Using Evidence and Collaboration for Setting and Defending Priorities

November 29, 2023

Stephanie Wade

"Integrate additional innovation skills like data analytics and behavioral economics to amplify the power of design."

Stephanie Wade

Building and Sustaining Design in Government

December 8, 2021

Jon Fukuda

"We’re lucky if we solve a single thing; everything else has to be parking lot."

Jon Fukuda Amy Evans Ignacio Martinez Joe Meersman

The Big Question about Innovation: A Panel Discussion

September 25, 2024