This video is only accessible to conference ticket holders.
Log in Create account
For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.
Contact Support if you are having any issues.
Summary
The Challenge Users engaging with the AI shopping assistant often felt constrained by limited options, excessive follow-up questions, and a lack of personalization. These shortcomings led to user fatigue, misunderstandings, and a subpar shopping experience. Insights from user research (UXR) and transcripts revealed that users wanted more intuitive, human-like interactions that catered to their unique needs. The Solution A robust, adaptable framework was designed to transform AI conversations into sales-like consultations. By breaking user queries into three core components—use-case, constraints, and preferences—the framework enabled the bot to understand intent and deliver relevant, personalized results. Key enhancements included: Allowing users to skip questions and navigate freely. Providing contextual help for technical queries. Transitioning to open-ended interactions after gathering essential details to prevent over-questioning. Displaying diverse and curated results aligned with user preferences.
Key Insights
-
•
Traditional conversational AI severely limits visual bandwidth compared to traditional e-commerce interfaces, hindering effective product exploration.
-
•
The catalog exploration paradox highlights the tension between rich visual browsing and conversational limitations in AI assistants.
-
•
The expectation gap occurs when AI fails to understand cultural or contextual nuances, eroding user trust and satisfaction.
-
•
User queries vary widely in specificity; treating all queries the same is a missed opportunity in AI design.
-
•
Structuring user queries into use case, constraints, and preferences enables AI to perform intelligent reasoning like a skilled salesperson.
-
•
Carefully crafted prompt design, rather than large-scale fine tuning, can effectively guide LLM reasoning for better conversational AI.
-
•
Adaptive questioning avoids unnecessary or repetitive queries, improving user experience and reducing frustration.
-
•
Designing conversational AI as reasoning systems rather than linear scripted flows fundamentally improves interaction quality.
-
•
A multidisciplinary team combining design, data, and engineering perspectives was crucial to solving this AI conversation challenge.
-
•
Shifting from seeing AI as a task execution tool to a trusted, empathetic guide changes user perception and engagement positively.
Notable Quotes
"We are designing how the assistant is trying to reason, moving from scripting responses to orchestrating the AI's cognitive process."
"It's not just about fixing the chatbot, it's about bridging the gap between user expectations and actual experiences."
"LLMs don't just match keywords or labels. They infer meaning, extract subtle nuances, and understand intent behind words."
"The catalog exploration paradox shows how current conversational AI restricts browsing and comparison, creating uncertainty."
"Users frequently felt overwhelmed and misunderstood; this was a significant barrier to a positive shopping experience."
"What if we actively taught the model how to break down and analyze queries like a skilled salesperson would?"
"The AI assistant starts with reasoning and not results, engaging users in intelligent conversation to understand needs."
"Don't design for a response, design for reasoning. Teach AI to think critically, analyze information, and arrive at logical conclusions."
"The assistant asks open-ended questions that focus on what truly matters: performance, budget, and preferences."
"We saw a 2.5 times increase in active monthly users and a 1.5 times increase in purchases attributed to the AI assistant."
Dig deeper—ask the Rosenbot:
More Videos
"Team ops goes wide to support 300-plus UX designers globally; product ops goes deep supporting 40-plus product design teams."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
"Slack clips can add tone and body language that is too hard to capture in the written word."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"Guardrail metrics help catch unintended consequences like increased customer service calls despite higher conversions."
Erin WeigelUX Lessons from running more than 1,200 A/B Tests
July 10, 2024
"You must remember this. A kiss is just a kiss. A sigh is just a sigh."
Susan Simon-DanielsWar Stories LIVE! Susan Simon-Daniels
March 30, 2020
"Doing design right early, just like failing early, helps to prevent time-consuming mistakes."
Noreen Whysel Katie SaindonShort Take #4: UX/Product Lessons from Your Industry Peers
December 6, 2022
"Links are first-class citizens in hypertext note-taking; connecting notes brings ideas to life and reveals new relationships."
Jorge ArangoExploding the Notebook: How to Unlock the Power of Linked Notes (2nd of 3 seminars)
April 19, 2024
"You can’t expect people to comply with standards if you don’t know who they are."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"It’s not just about the customer experience but also the employee experience, and they must coincide."
Zariah CameronStreamlining an Inclusive Design Practice
October 3, 2023
"Starting small with local meetups or internal talks helps you test and improve your material before bigger stages."
Louis Rosenfeld Jemma Ahmed Christian Crumlish Uday Gajendar Chris GeisonCoffee with Lou #3: What Makes for a Successful UX Conference Presentation?
May 2, 2024
