Summary
It seems like every company is adding a conversational AI chatbot to their website lately, but how do you actually go about making these experiences valuable and intuitive? Savannah Carlin will present a case study on a conversational AI chatbot—Marqeta Docs AI—that she designed for a developer documentation site in the fintech industry. She will share her insights, mistakes, and perspectives on how to use AI in a meaningful, seamless way, especially for companies like Marqeta that operate in highly regulated industries with strict compliance standards. The talk will use specific examples and visuals to show what makes conversational AI interactions uniquely challenging and the design patterns that can address those challenges. These include managing user expectations, handling errors or misunderstandings within the conversation, and ensuring that users can quickly judge the quality of a bot’s response. You’ll gain a deeper understanding of the intricacies involved in designing interactions for AI, along with practical advice you can apply in your own design processes. Take-aways What to consider before you add AI to your product to ensure it will be valuable, usable, and safe for its intended workflows The interactions that are unique to conversational AI experiences and the design patterns that work for them Common challenges in designing conversational AI experiences and how to overcome them
Key Insights
-
•
Prioritize clear use case definitions for AI tools.
-
•
High quality training data is crucial for chatbot success.
-
•
Initial user engagement should set clear expectations with specific messaging.
-
•
Design for effective loading experiences to accommodate variable speeds.
-
•
Support user navigation with intuitive scrolling and output summaries.
-
•
Error states in AI require guiding users to reformulate prompts, rather than just displaying errors.
-
•
Transparency in AI capabilities and limitations helps build user trust.
-
•
Accessibility considerations should be integrated throughout the design process.
-
•
Feedback mechanisms are essential for continuous improvement of chatbot performance.
-
•
Iterative design allows for refining user interactions and measuring engagement.
Notable Quotes
"Being clear on the primary use case is even more important now."
"If you have any doubts about the quality of the training data, do not proceed."
"The mental models are still early in forming for these tools."
"Loading indicators help users understand progress while waiting for output."
"Error states become about helping users write prompts effectively."
"Transparency is crucial, especially in regulated spaces like FinTech."
"Accessibility should be part of the testing plan from the beginning to the end."
"Our bot showed that it could decrease the friction for users to learn about MARTA."
"The chatbot had a much narrower scope to maintain accuracy and relevance."
"Being cautious about managing user expectations is vital to maintaining trust."
More Videos
"Data management is crucial; AI doesn't function well when organization and data are siloed."
Erika FlowersAI-Readiness: Preparing NASA for a Data-Driven, Agile Future
June 10, 2025
"Public perception is shifting towards a demand for more ethical practices from companies."
Cennydd BowlesResponsible Design in Reality
June 9, 2021
"We need to understand the preferences of gamers a little bit better."
Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl PlatzBeyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries
May 17, 2024
"We're focused on the evolution of design ops at scale."
Bud CaddellTheme 2 Intro
September 30, 2021
"We are the ones who can highlight inequity and inform better practices."
Steve PortigalLooking Back…to Look Ahead
March 26, 2024
"Janice remarked that community support is vital for overcoming research challenges."
Mike Oren Janice WiitalaDesign Research Strategy & Strategic Design Research
February 3, 2022
"When teams start to feel powerless, they take on bizarre behaviors like cutting corners."
Jen CardelloStandardizing Product Merits for Leaders, Designers, and Everyone
June 15, 2018
"When it's coming from the top, it looks like strategy."
Harry Max Jim MeyerPrioritization for Leaders (2nd of 3 seminars)
June 27, 2024
"AI can help organize content very effectively, both faster and at larger scales than humans can."
Jorge ArangoScale Smart: AI-Powered Content Organization Strategies
September 24, 2024
