Rosenverse
Sentient Scenes and Radically Adaptive Experiences

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Sentient Scenes and Radically Adaptive Experiences

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the AI and UX playlist and 2 more.

Share the love for this talk
Sentient Scenes and Radically Adaptive Experiences
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.

Key Insights

  • •

    AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.

  • •

    Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.

  • •

    Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.

  • •

    Large language models excel more at parsing user intent than merely providing factual answers.

  • •

    The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.

  • •

    Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.

  • •

    Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.

  • •

    Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.

  • •

    AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.

  • •

    Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.

Notable Quotes

"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."

"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."

"We wanted to create personality in interfaces without pretending they are human."

"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."

"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."

"The prompt becomes part design spec, part requirement doc, and part programming language."

"Large language models are far better at figuring out what you mean than simply giving an answer."

"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."

"AI can transform accessibility by changing experiences to meet user needs in the moment."

"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."

Ask the Rosenbot
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Shan Shen
Translating UX Terms into Business Contexts
2023 • Design in Product 2023
Gold
Lija Hogan
Contexts of Use: A Framework for Connection
2021 • Civic Design 2021
Gold
Chris Govias
Perspectives on Civic Design
2021 • Civic Design Community
Dante Guintu
How to Crush the Talent Crunch
2022 • DesignOps Summit 2022
Gold
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
Theresa Neil
Designing for Wellness: Specializing in Healthcare
2024 • Rosenfeld Community
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 2: Evals are your moat
2025 • Rosenfeld Community
Erika Kincaid
Connecting the Dots: How to Foster Collaboration and Build a Strong Design Review Culture
2022 • Design at Scale 2022
Gold
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Gold
Amanda Kaleta-Kott
The Joys and Dilemmas of Conducting UX Research with Older Adults
2022 • Advancing Research 2022
Gold
Mansi Gupta
Women-Centric Research: What, Why, How
2023 • Advancing Research 2023
Gold
Erin Weigel
Testing and Experimentation Tools
2026 • Advancing Research 2026
Gold
Patrick Boehler
Fishing for Real Needs: Reimagining Journalism Needs with AI
2025 • Designing with AI 2025
Gold
JP Allen
Navigating the UX Tool Landscape
2021 • Advancing Research 2021
Gold
Peter Van Dijck
The Bag of Skills: Building Resiliency into Your UX Career While the Market Catches Up
2026 • Rosenfeld Community

More Videos

Dr. Karl Jeffries

"If you said are you creative, I’m gonna say hell yeah."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"There’s been a huge convergence because everybody’s got a mobile device now and expects a certain kind of experience."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"The core of it is really putting yourself in that other person’s shoes—it’s basic but essential empathy."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"One designer's security in a dedicated model may be another designer's stagnation."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"The only rule is to maintain your smile and just to feel the being that have fun."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"Field usability testing showed stakeholders immediately how much value UX can add by catching issues before deployment."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"We made it a priority from day one to support data exports so customers can leave without wasting weeks migrating data."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"The incentive structure at a big company is set up to reward people for entirely different stuff than innovation requires."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"You’ve got to take control of the backlog and position your team as value-driven, not just servicing individual teams."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books