Rosenverse
Don't botch the bot: Designing interactions for AI

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Don't botch the bot: Designing interactions for AI

Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Don't botch the bot: Designing interactions for AI
Speakers: Savannah Carlin
Link:

Summary

It seems like every company is adding a conversational AI chatbot to their website lately, but how do you actually go about making these experiences valuable and intuitive? Savannah Carlin will present a case study on a conversational AI chatbot—Marqeta Docs AI—that she designed for a developer documentation site in the fintech industry. She will share her insights, mistakes, and perspectives on how to use AI in a meaningful, seamless way, especially for companies like Marqeta that operate in highly regulated industries with strict compliance standards. The talk will use specific examples and visuals to show what makes conversational AI interactions uniquely challenging and the design patterns that can address those challenges. These include managing user expectations, handling errors or misunderstandings within the conversation, and ensuring that users can quickly judge the quality of a bot’s response. You’ll gain a deeper understanding of the intricacies involved in designing interactions for AI, along with practical advice you can apply in your own design processes. Take-aways
  • What to consider before you add AI to your product to ensure it will be valuable, usable, and safe for its intended workflows
  • The interactions that are unique to conversational AI experiences and the design patterns that work for them
  • Common challenges in designing conversational AI experiences and how to overcome them

Key Insights

  • •

    Defining a clear and specific primary use case is crucial before starting any generative AI chatbot project.

  • •

    High-quality, thoroughly reviewed training data is foundational to delivering accurate and useful AI outputs.

  • •

    Initial state messaging must clearly frame what the chatbot can and cannot help with to reduce irrelevant or off-topic queries.

  • •

    Loading indicators for AI text responses should be subtle, with progress reflected by text appearing rather than distracting animations.

  • •

    Supporting efficient scrolling and prompt review is vital since users frequently check and refine their inputs against often long answers.

  • •

    Error states in AI chatbots shift from traditional fixed errors to helping users write better prompts to get more relevant results.

  • •

    Transparency about accuracy, AI limitations, and source citations builds user trust, especially in regulated domains like FinTech.

  • •

    Providing users with prompt engineering guidance via documentation significantly improves the quality of chatbot interactions.

  • •

    Accessibility considerations, like keyboard navigation and screen reader compatibility, must be integrated from the start, especially given the large text outputs.

  • •

    Chatbots can reduce customer support friction and encourage users to ask questions they might not have otherwise, enhancing user engagement with the product.

Notable Quotes

"If you have any doubts about the quality of the training data, do not proceed."

"You want to assist people in framing the interaction and setting their expectations correctly so they know how to be successful."

"The biggest difference with error states in AI bots is helping people write prompts effectively, not just recovering from simple failures."

"Loading text itself is a loading indicator; the letters appearing show progress better than jumpy animations."

"People often forget what they wrote and then want to check their prompt again before refining it."

"Every output should have at least three source links, almost like citations in a research paper."

"We had to be very careful about accuracy because we're in FinTech and compliance is critical."

"People started asking questions to the bot that they wouldn’t have taken the time to email about."

"It’s really important to be clear and transparent about what the tool is good at and what it’s not good at."

"Accessibility testing included making sure everyone could navigate it using a keyboard alone."

Ask the Rosenbot
Patrick Neeman
Agent Standards Best Viewed in Every Assistant
2026 • Rosenfeld Community
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Community
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Cennydd Bowles
Exit Interview #2: Rediscovering the ethical heart of design
2025 • Rosenfeld Community
Erin Hauber
Design is Not the Frosting on the Scaled Agile Layer Cake
2019 • DesignOps Summit 2019
Gold
Lisa Gironda
Opener: Chief of Staff–An unexpected journey
2024 • DesignOps Summit 2020
Gold
Davis Neable
How to Drive a Design Project When you Don’t Have a Design Team
2021 • Design at Scale 2021
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Catt Small
Your Future is Nebulous—and Why That's Good
2026 • Shift UX 2026
Conference
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Jemma Ahmed
Bridge Building across Research Disciplines
2021 • Advancing Research Community
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Maria Giudice
Remaking the Making Company: Moving from Product to Experience
2016 • Enterprise UX 2016
Gold
Christian Rohrer
Research Operations at Scale
2017 • DesignOps Summit 2017
Gold

More Videos

Dr. Karl Jeffries

"Creativity fuels design, design fuels innovation."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"There’s been a huge convergence because everybody’s got a mobile device now and expects a certain kind of experience."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"The weakest insight method might win simply because of the relationship to the power structure."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"One designer's security in a dedicated model may be another designer's stagnation."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"We want to stay in the game no users cursing our name."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"We can’t complain about not having a seat at the table if we don’t offer one of our own."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"It’s very difficult to align researcher goals with business growth, but that’s exactly what we try to do."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"Lawyers, though nervous, can become some of the most reasonable people you deal with if you explain risks clearly."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"Without Jim, what we're going to see today would have been a lot worse."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books