Rosenverse
Sentient Scenes and Radically Adaptive Experiences

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Sentient Scenes and Radically Adaptive Experiences

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist and 2 more.

Share the love for this talk
Sentient Scenes and Radically Adaptive Experiences
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.

Key Insights

  • •

    AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.

  • •

    Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.

  • •

    Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.

  • •

    Large language models excel more at parsing user intent than merely providing factual answers.

  • •

    The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.

  • •

    Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.

  • •

    Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.

  • •

    Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.

  • •

    AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.

  • •

    Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.

Notable Quotes

"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."

"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."

"We wanted to create personality in interfaces without pretending they are human."

"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."

"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."

"The prompt becomes part design spec, part requirement doc, and part programming language."

"Large language models are far better at figuring out what you mean than simply giving an answer."

"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."

"AI can transform accessibility by changing experiences to meet user needs in the moment."

"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Jack Moffett
SAFe or Sorry?
2019 • Enterprise Community
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization
2020 • Enterprise Community
Bruce Gillespie
Learning from journalism: Balancing impactful communication with compassionate storytelling
2025 • Advancing Research 2025
Gold
Ashley Cortez
Shifting Toward Community-Led Innovation in Local Government
2021 • Civic Design 2021
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Catherine Blizzard
Using Integrated Insight to Drive Growth
2022 • Advancing Research 2022
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Elizabeth Churchill
Exploring Cadence: You, Your Team, and Your Enterprise
2017 • Enterprise Experience 2017
Gold
JP Allen
Navigating the UX Tool Landscape
2021 • Advancing Research 2021
Gold
Bria Alexander
Charting the future of DesignOps: A community workshop
2024 • DesignOps Community
Vanessa Varin
Tools are moments. Capabilities compound.
2026 • Designing with AI 2026
Gold
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 1: The new product journey
2025 • Rosenfeld Community
Uday Gajendar
Theme Four Intro
2023 • Enterprise UX 2023
Gold

More Videos

Chris Geison

"This is a weird time for research. Layoffs have torn through our field."

Chris Geison

Theme Two Intro

March 28, 2023

Toby Haug

"When I talk to stakeholders, I try to understand how they are measured and what success means for their role in the company."

Toby Haug

Discussion

June 9, 2017

Zen Ren

"As researchers, our job is to explore behaviors which are driven by knowledge and make insights that can alter what our users learn and do."

Zen Ren

Taking Inspiration from Instructional Design for Research

March 10, 2022

Meghan Bausone

"Birth centers would be replicable if reimbursement structures were adequate, but they can't survive without payment."

Meghan Bausone

Systems Thinking and Design Innovation: Working with Leverage Points in Rural Maternal Health Systems

April 17, 2026

Julie Gitlin

"A new joiner meeting someone 10 months in who’s still meeting new people shows the scale and complexity of JP Morgan."

Julie Gitlin Esther Raice

Design as an Agent of Digital Transformation at JPMC

June 9, 2021

Lija Hogan

"Having a diverse team helps ensure you’re asking the right questions in research and design."

Lija Hogan

Practical Principles of Inclusive Research

March 27, 2023

Savina Hawkins

"These AI tools can do the entire qualitative analysis process at the click of a button."

Savina Hawkins

Harnessing AI in UXR: Practical Strategies for Positive Impact

March 26, 2024

Dominique Ward

"We’re really in the game of behavioral change—planting seeds today so teams move naturally towards the future."

Dominique Ward

The Most Exciting Time for DesignOps is Now

September 8, 2022

Laura Weiss

"Taking a coaching approach supports the other person’s discovery and offers the greatest possibility for change."

Laura Weiss

There is No Playbook: Leader as Coach During Challenging Times

April 26, 2024