Rosenverse
Don't botch the bot: Designing interactions for AI

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Don't botch the bot: Designing interactions for AI

Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Don't botch the bot: Designing interactions for AI
Speakers: Savannah Carlin
Link:

Summary

It seems like every company is adding a conversational AI chatbot to their website lately, but how do you actually go about making these experiences valuable and intuitive? Savannah Carlin will present a case study on a conversational AI chatbot—Marqeta Docs AI—that she designed for a developer documentation site in the fintech industry. She will share her insights, mistakes, and perspectives on how to use AI in a meaningful, seamless way, especially for companies like Marqeta that operate in highly regulated industries with strict compliance standards. The talk will use specific examples and visuals to show what makes conversational AI interactions uniquely challenging and the design patterns that can address those challenges. These include managing user expectations, handling errors or misunderstandings within the conversation, and ensuring that users can quickly judge the quality of a bot’s response. You’ll gain a deeper understanding of the intricacies involved in designing interactions for AI, along with practical advice you can apply in your own design processes. Take-aways
  • What to consider before you add AI to your product to ensure it will be valuable, usable, and safe for its intended workflows
  • The interactions that are unique to conversational AI experiences and the design patterns that work for them
  • Common challenges in designing conversational AI experiences and how to overcome them

Key Insights

  • •

    Defining a clear and specific primary use case is crucial before starting any generative AI chatbot project.

  • •

    High-quality, thoroughly reviewed training data is foundational to delivering accurate and useful AI outputs.

  • •

    Initial state messaging must clearly frame what the chatbot can and cannot help with to reduce irrelevant or off-topic queries.

  • •

    Loading indicators for AI text responses should be subtle, with progress reflected by text appearing rather than distracting animations.

  • •

    Supporting efficient scrolling and prompt review is vital since users frequently check and refine their inputs against often long answers.

  • •

    Error states in AI chatbots shift from traditional fixed errors to helping users write better prompts to get more relevant results.

  • •

    Transparency about accuracy, AI limitations, and source citations builds user trust, especially in regulated domains like FinTech.

  • •

    Providing users with prompt engineering guidance via documentation significantly improves the quality of chatbot interactions.

  • •

    Accessibility considerations, like keyboard navigation and screen reader compatibility, must be integrated from the start, especially given the large text outputs.

  • •

    Chatbots can reduce customer support friction and encourage users to ask questions they might not have otherwise, enhancing user engagement with the product.

Notable Quotes

"If you have any doubts about the quality of the training data, do not proceed."

"You want to assist people in framing the interaction and setting their expectations correctly so they know how to be successful."

"The biggest difference with error states in AI bots is helping people write prompts effectively, not just recovering from simple failures."

"Loading text itself is a loading indicator; the letters appearing show progress better than jumpy animations."

"People often forget what they wrote and then want to check their prompt again before refining it."

"Every output should have at least three source links, almost like citations in a research paper."

"We had to be very careful about accuracy because we're in FinTech and compliance is critical."

"People started asking questions to the bot that they wouldn’t have taken the time to email about."

"It’s really important to be clear and transparent about what the tool is good at and what it’s not good at."

"Accessibility testing included making sure everyone could navigate it using a keyboard alone."

Ask the Rosenbot
Renee Reid
Becoming a ResearchH.E.R (Highly Enterprise Ready)
2019 • Enterprise Experience 2019
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold
JD Buckley
COMMUNICATE: Discussion
2018 • Enterprise Experience 2018
Gold
Brendan Jarvis
It was the Best of Times. It was the Worst of Times.
2024 • DesignOps Summit 2024
Gold
Bob Baxley
Theme 4: Discussion
2024 • Enterprise Experience 2020
Gold
Bria Alexander
Day 2 Welcome
2024 • DesignOps Summit 2024
Gold
Jaime Creixems
Best Practices when Creating and Maintaining a Design System
2023 • Enterprise UX 2023
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Sarah Brooks
Theme 3 Intro
2021 • Civic Design 2021
Gold
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold
Rebecca Topps
Planning and conducting remote usability studies for accessibility
2020 • Advancing Research Community
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold
Emilia Åström
Unlock Your Team’s Intelligence with Collaboration Design
2022 • Design at Scale 2022
Gold
Tricia Wang
Spatial Collapse: Designing for Emergent Culture
2024 • Enterprise Experience 2020
Gold
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold

More Videos

Uday Gajendar

"Nobody wants to buy or use a sloppy product, especially when enterprise users rely on the apps for 8 to 10 hours a day."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Jayne Engle

"Sacred civics requires us to hold higher order accountabilities to ecosystems and future generations."

Jayne Engle Tanya Chung-Tiam-Fook

Civic Design for the Next Seven Generations—A Discussion on Sacred Civics

August 25, 2022

Kristin Skinner

"There is no one size fits all. Go in, do your research, and find where the failure points are."

Kristin Skinner

Opening Keynote: Org Design for Design Orgs

November 6, 2017

Dan Saffer

"Don Norman was named the top accomplished woman in UX by AI, even though Don is a man."

Dan Saffer

Why AI projects fail (and what we can do about it)

May 14, 2025

Bria Alexander

"Sometimes resources are available as soon as an hour or 30 minutes after the talk, like the team is working miracles."

Bria Alexander

Day 2 Welcome

September 24, 2024

Daniela Magaña Flores

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Laine Riley Prokay

"These brand new practitioners can bring fresh perspectives and new ways of thinking to hopefully see current problems in a new light."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Luke Roberts

"We need leadership that elicits trust, is regenerative, and builds hope for future generations."

Luke Roberts Christian Bason, Ph.D. Amanda Woolley Ben Reason

Panel Discussion

December 4, 2024

Michal Anne Rogondino

"Our modern way of life is actually really dependent on satellites."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Latest Books All books