Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
Wednesday, January 29, 2025 • Rosenfeld Community

This video is featured in the AI and UX playlist.

Share the love for this talk
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

How do you get your head around all the different machine-intelligent experiences available to you as a designer? What are the new design patterns, and which old ones fall away? How do you name and organize those experiences? And how do you develop an intuition for how and when to use each interaction paradigm? Watch Josh Clark and Veronika Kindred, authors of our forthcoming book Sentient Design, explore the emerging diversity of AI-mediated experiences. Just as the natural world demonstrates intelligence in many forms, the same is true for machine intelligence. New “species” of interfaces roam our screens, the manner of each tailored to purpose and environment—copilots, agents, chatbots, assistants, tools, adaptive interfaces, and many more. Sentient Design offers a framework for exploring and organizing these new experience patterns, or “postures”—the way each kind of experience positions itself in relation to the user. More than just distinct functionality, each posture has its own interaction style, manner of communication, and expectations that it sets. Josh and Veronika share over a dozen of these postures, from familiar options like dedicated tools to more exotic patterns including sculptors, bespoke UI, non-player characters, and data whisperers. Get a map for exploring these postures to expand both your perspective and your toolkit as a designer.

Key Insights

  • Sentient Design reframes AI as a design material that enables adaptive, context-aware experiences rather than just a tool for output generation.

  • The Sentient Triangle categorizes AI experiences by grounded accuracy, interoperability, and radical adaptivity to better understand their trade-offs.

  • Four key interface postures—tools, sculptors, assistants, and agents—describe how AI interfaces relate to users, from simple inputs/outputs to autonomous task management.

  • Traditional deterministic tools like Shazam remain powerful but represent early-stage AI experiences compared to more interactive and adaptive forms.

  • Inline tools integrate AI assistance seamlessly within user workflows, offering continuous and ambient support without breaking context.

  • Sculptor interfaces enable iterative collaborative content creation, exemplified by in-painting in image and audio editing.

  • Chat-based characters and personas excel in creative, exploratory scenarios where factual accuracy is less critical than engagement.

  • Agents increasingly perform delegated tasks autonomously but currently face challenges with brittle, slow, and complex multi-step workflows.

  • Bespoke UIs dynamically generate or rearrange interface components in real-time tailored to user intent, enhancing flexibility and personalization.

  • Designers must embrace AI’s inherent weirdness and unpredictability as an asset, balancing risk and opportunity to create new interaction paradigms.

Notable Quotes

"Sentient design is about intelligent interfaces that are aware of context and intent so they can be radically adaptive to user needs in the moment."

"We think of AI not just as a maker of stuff but as an enabler of experiences."

"These intelligent interfaces are collaborative, proactive partners on the user’s journey."

"Traditional software is grounded—accurate and reliable—but lacks radical adaptivity."

"In-painting allows precise, targeted edits that don’t disturb the rest of the content."

"Characters live at the extreme of radically adaptive AI—they react in the moment and follow the user’s lead."

"Assistance interfaces combine open-ended dialogue with the ability to do tasks on your behalf."

"Agents set goals, plan steps, execute them, and decide when they’re done, often without user attention."

"Bespoke UI can generate interfaces on the fly based on immediate need or intent."

"Embracing AI’s weirdness can turn unpredictable outputs into experience assets rather than liabilities."

Ask the Rosenbot
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Christopher Geison
Theme 1 Intro
2024 • Advancing Research 2024
Gold
Chris Geison
Theme 1 Intro
2022 • Advancing Research 2022
Gold
Chris Geison
What is Research Strategy?
2021 • Advancing Research 2021
Gold
Ariel Kennan
Theme Two Intro
2022 • Civic Design 2022
Gold
Ryan Rumsey
Business Influence Without Losing Your Soul
2021 • Enterprise Community
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Nalini P. Kotamraju
An Organizational Story: Salesforce Lightning Design System
2016 • Enterprise UX 2016
Gold
Noreen Whysel
Short Take #4: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Deanna Washington
Connecting the Ops: Plenary Panel and Closing Circle
2022 • DesignOps Summit 2022
Gold
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Laureen Kattan
Centering Patients and Clinicians in a Complex Government Ecosystem
2023 • Design in Product 2023
Gold
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Abby Covert
Stuck? Diagrams Help
2022 • DesignOps Community
Alex Hurworth
Designing a Contact Tracing App for Universal Access
2020 • DesignOps Summit 2020
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold

More Videos

Sam Proulx

"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

December 9, 2021

Michael Land

"We’re trying to build a design operations role that balances top-down governance with bottom-up community building."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Shipra Kayan

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Ian Swinson

"A workshop helps people map their skills, identify gaps, and make specific goals for career jumps."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Isaac Heyveld

"The chief of staff is the bridge between our executive leadership team and the design ops practitioners."

Isaac Heyveld

Expand DesignOps Leadership as a Chief of Staff

September 8, 2022

Amy Evans

"Change is messy and it can be uncomfortable, much like baking bread—it’s hard to imagine sticky dough turning into a perfect loaf."

Amy Evans

How to Create Change

September 25, 2024

Kate Koch

"Design ops is undergoing a transformation into a CX focused team with a refined mission to drive efficiency and customer experience excellence."

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Dave Gray

"Beliefs are habits of action; they are the rules that guide how we decide to act."

Dave Gray

Liminal Thinking: Sense-making for systems in large organizations

May 14, 2015

Matt Duignan

"Product teams want quick, grab-and-go research results, but reusable insights are more abstract and take longer to digest."

Matt Duignan

Atomizing Research: Trend or Trap

March 30, 2020