Rosenverse
Sentient Scenes and Radically Adaptive Experiences

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Sentient Scenes and Radically Adaptive Experiences

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist and 2 more.

Share the love for this talk
Sentient Scenes and Radically Adaptive Experiences
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.

Key Insights

  • •

    AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.

  • •

    Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.

  • •

    Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.

  • •

    Large language models excel more at parsing user intent than merely providing factual answers.

  • •

    The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.

  • •

    Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.

  • •

    Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.

  • •

    Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.

  • •

    AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.

  • •

    Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.

Notable Quotes

"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."

"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."

"We wanted to create personality in interfaces without pretending they are human."

"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."

"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."

"The prompt becomes part design spec, part requirement doc, and part programming language."

"Large language models are far better at figuring out what you mean than simply giving an answer."

"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."

"AI can transform accessibility by changing experiences to meet user needs in the moment."

"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."

Ask the Rosenbot
Jacqui Frey
Setting the Table for Dynamic Change
2019 • DesignOps Summit 2019
Gold
Phil Hesketh
Designing Accessible Research Workflows
2021 • DesignOps Summit 2021
Gold
Joe Meersman
Use AI to Drive Outcomes that Go Beyond the Design Sprint
2024 • DesignOps Summit 2024
Gold
DesignOps and The Great Talent War of 2021
2021 • DesignOps Community
Sabrina Mach
How to Design Your Design Operating Model
2021 • DesignOps Summit 2021
Gold
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold
Todd Healy
Driving Change with CX Metrics
2023 • Enterprise UX 2023
Gold
Michelle Morrison
Culture Design
2020 • DesignOps Community
The AI + Design wave has arrived: Making sense of the 2026 AI + Design Report
2026 • Rosenfeld Community
Karen Pascoe
Developing Experience Teams and Talent in the Enterprise
2016 • Enterprise UX 2016
Gold
Aras Bilgen
Who does the math: A designer’s journey in building an AI-based tutoring app
2025 • Designing with AI 2025
Gold
Tamara Kartoziia
Think global, adapt local: how service design accelerated B2B market entry by 6 months
2025 • Advancing Service Design 2025
Gold
Briana Thomas
When Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org
2021 • DesignOps Summit 2021
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Kelly Goto
Emotion Economy: Ethnography as Corporate Strategy
2015 • Enterprise UX 2015
Gold

More Videos

Victor M. Gonzalez

"We emphasize collaboration, not individual work, to build teams and collective knowledge."

Victor M. Gonzalez

Practicing Learners and Learning Practitioners

March 10, 2021

Ross Smith

"The Skype engineers spent time in the community chatting with users and made product changes based on those conversations."

Ross Smith

Breaking Barriers with Empathy

June 9, 2017

Sofia Quintero

"We made it a priority from day one to support data exports so customers can leave without wasting weeks migrating data."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Dagmara Kukawka

"Scale without guardrails becomes chaos. Coaching not caretaking protects learning and accountability."

Dagmara Kukawka

Tiny team, moonshot impact: Democratizing research across continents

March 10, 2026

Prayag Narula

"Feature bloat kills usability because it clouds the core value proposition."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

Kathleen Asjes

"Research maturity refers to how research knowledge and impact permeate the organization, not individual skills."

Kathleen Asjes

Research Democratization: the Good, the Bad and the Ugly

March 10, 2022

Alla Weinberg

"Work gets done through our relationships, and that becomes more true the higher you go in your career."

Alla Weinberg

Cross-Functional Relationship Design

December 6, 2022

Luke Wroblewski

"The evolution in AI UIs is ongoing and rapid, and we’re still figuring out what the final form of AI-native applications looks like."

Luke Wroblewski

Designing AI Applications

March 5, 2026

Sarah Sgarlato Pierini

"We simply told leadership we don’t even know what we don’t know or what we do know, leading to a research insights repository."

Sarah Sgarlato Pierini Kevin Newton

From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn

September 9, 2022