Rosenverse
Sentient Scenes and Radically Adaptive Experiences

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Sentient Scenes and Radically Adaptive Experiences

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist and 2 more.

Share the love for this talk
Sentient Scenes and Radically Adaptive Experiences
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.

Key Insights

  • AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.

  • Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.

  • Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.

  • Large language models excel more at parsing user intent than merely providing factual answers.

  • The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.

  • Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.

  • Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.

  • Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.

  • AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.

  • Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.

Notable Quotes

"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."

"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."

"We wanted to create personality in interfaces without pretending they are human."

"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."

"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."

"The prompt becomes part design spec, part requirement doc, and part programming language."

"Large language models are far better at figuring out what you mean than simply giving an answer."

"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."

"AI can transform accessibility by changing experiences to meet user needs in the moment."

"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."

Ask the Rosenbot
Neema Mahdavi
Operationalizing DesignOps
2018 • DesignOps Summit 2018
Gold
Dana Bishop
2022: The Year UX Demonstrates its Business Impact
2022 • Advancing Research 2022
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Meaghan Waters
Lack of Product Thinking will Doom Your Legacy Modernization
2021 • Design at Scale 2021
Gold
Joshua Graves
We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)
2025 • Rosenfeld Community
Kyria Stephens
Power to Heal: Civic Design in the Aftermath of Tragedy
2022 • Civic Design 2022
Gold
Paul Bakaus
Killing the handoff: Iterating design live in the browser on real production code
2026 • Designing with AI 2026
Conference
You’ve got Gold! A Rosenverse demo with Lou Rosenfeld
2026 • Rosenfeld Community
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Kyle Godbey
Non-linear service design for complex adaptive systems
2025 • Rosenfeld Community
Kristen Guth, Ph.D.
Out of the FOG: A Non-traditional Research Approach to Alignment
2023 • Advancing Research 2023
Gold
Jacqui Frey
Scale is Social Work
2020 • DesignOps Community
Jules Monza
Use These Words and Count These Things
2024 • DesignOps Summit 2024
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Advancing Research 2022
Gold

More Videos

Bas Raijmakers, PhD (RCA)

"Contextualizing sound bites or clips is crucial; otherwise, they risk losing meaning when separated from their original story."

Bas Raijmakers, PhD (RCA) Charley Scull Prabhas Pokharel

What Design Research can Learn from Documentary Filmmaking

March 11, 2022

Tamara Kartoziia

"Service design stops being just a support function; it becomes the strategic driver that transforms organizational performance."

Tamara Kartoziia

Think global, adapt local: how service design accelerated B2B market entry by 6 months

November 20, 2025

Anupama Dhareshwar

"Involving frontline staff as co-creators helps ensure AI is a collaborator rather than a threat."

Anupama Dhareshwar

From blueprint to bot: Designing resilient AI-powered services

November 19, 2025

Yulya Besplemennova

"This is a hero moment because it accelerates and simplifies exploration of clustering options."

Yulya Besplemennova

[Demo] Stress-testing GenAI in user research synthesis

June 4, 2024

Giff Constable

"You want to flex one or two variables to create range scenarios—best case, middle case, and worst case."

Giff Constable

Financial fluency for product leaders: AMA with Giff Constable

April 11, 2024

Catherine Dubut

"In large organizations, soft skills are the hard skills—it's all about how you connect with humans and express your core values."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Yolanda Rankin

"Games may seem like recreation, but they also serve as alternative pedagogical tools and cultural spaces."

Yolanda Rankin

Black Feminist Epistemology as a Critical Framework for Equitable Design

March 11, 2021

Brigette Metzler

"Put more in than you take out — that’s the rule of thumb I give for contributing to repositories."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community

August 27, 2020

Ryan Matthew

"Figma natively only allows 40 variable modes, but our client required around 90 different modes to handle age groups and device types."

Ryan Matthew Alex Kurchev

DesignOps without Boundaries: Building More with What You Have

September 10, 2025