Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Optimizing AI Conversations: A Case Study on Personalized Shopping Assistance Frameworks
Gold
Tuesday, June 10, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist.

Share the love for this talk
Optimizing AI Conversations: A Case Study on Personalized Shopping Assistance Frameworks
Speakers: Kritika Yadav
Link:

Summary

The Challenge Users engaging with the AI shopping assistant often felt constrained by limited options, excessive follow-up questions, and a lack of personalization. These shortcomings led to user fatigue, misunderstandings, and a subpar shopping experience. Insights from user research (UXR) and transcripts revealed that users wanted more intuitive, human-like interactions that catered to their unique needs. The Solution A robust, adaptable framework was designed to transform AI conversations into sales-like consultations. By breaking user queries into three core components—use-case, constraints, and preferences—the framework enabled the bot to understand intent and deliver relevant, personalized results. Key enhancements included: Allowing users to skip questions and navigate freely. Providing contextual help for technical queries. Transitioning to open-ended interactions after gathering essential details to prevent over-questioning. Displaying diverse and curated results aligned with user preferences.

Key Insights

  • Traditional conversational AI severely limits visual bandwidth compared to traditional e-commerce interfaces, hindering effective product exploration.

  • The catalog exploration paradox highlights the tension between rich visual browsing and conversational limitations in AI assistants.

  • The expectation gap occurs when AI fails to understand cultural or contextual nuances, eroding user trust and satisfaction.

  • User queries vary widely in specificity; treating all queries the same is a missed opportunity in AI design.

  • Structuring user queries into use case, constraints, and preferences enables AI to perform intelligent reasoning like a skilled salesperson.

  • Carefully crafted prompt design, rather than large-scale fine tuning, can effectively guide LLM reasoning for better conversational AI.

  • Adaptive questioning avoids unnecessary or repetitive queries, improving user experience and reducing frustration.

  • Designing conversational AI as reasoning systems rather than linear scripted flows fundamentally improves interaction quality.

  • A multidisciplinary team combining design, data, and engineering perspectives was crucial to solving this AI conversation challenge.

  • Shifting from seeing AI as a task execution tool to a trusted, empathetic guide changes user perception and engagement positively.

Notable Quotes

"We are designing how the assistant is trying to reason, moving from scripting responses to orchestrating the AI's cognitive process."

"It's not just about fixing the chatbot, it's about bridging the gap between user expectations and actual experiences."

"LLMs don't just match keywords or labels. They infer meaning, extract subtle nuances, and understand intent behind words."

"The catalog exploration paradox shows how current conversational AI restricts browsing and comparison, creating uncertainty."

"Users frequently felt overwhelmed and misunderstood; this was a significant barrier to a positive shopping experience."

"What if we actively taught the model how to break down and analyze queries like a skilled salesperson would?"

"The AI assistant starts with reasoning and not results, engaging users in intelligent conversation to understand needs."

"Don't design for a response, design for reasoning. Teach AI to think critically, analyze information, and arrive at logical conclusions."

"The assistant asks open-ended questions that focus on what truly matters: performance, budget, and preferences."

"We saw a 2.5 times increase in active monthly users and a 1.5 times increase in purchases attributed to the AI assistant."

Ask the Rosenbot
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Alnie Figueroa
The Future of Design Operations: Transforming Our Craft
2025 • DesignOps Summit 2025
Gold
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Billy Carlson
Pro-level UI Tips for Beginners
2022 • DesignOps Summit 2022
Gold
Gabriela Barneva
Operationalizing Inclusive Design in Service Design
2025 • Advancing Service Design 2025
Conference
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis
2020 • Enterprise Community
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!
2025 • Rosenfeld Community
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold
Ned Gartside
Navigating accessibility and climate
2024 • Climate UX Interest Group
Sam Proulx
Mobile Accessibility and You
2022 • Design at Scale 2022
Gold
Dalia El-Shimy
So You've Got a Seat at the Table. Now What?
2020 • Advancing Research 2020
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Alexis Lucio
Scaling Accessibility Through Design Systems
2022 • Design at Scale 2022
Gold
Tricia Wang
Spatial Collapse: Designing for Emergent Culture
2024 • Enterprise Experience 2020
Gold

More Videos

John Calhoun

"Design teams don’t want a design ops drill, they need a quarter inch hole that requires a little bit of program management."

John Calhoun Rachel Posman

Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps

September 24, 2024

Nicole Bergstrom

"Nothing about us without us—people with disabilities must be involved in design and AI development."

Nicole Bergstrom Anna Cook Kate Kalcevich Saara Kamppari-Miller

AccessibilityOps: Moving beyond “nice to have”

September 19, 2024

Louis Rosenfeld

"The Rosen bot gives you sourced, clickable links to books and videos, so you can dig deeper."

Louis Rosenfeld

The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld

June 5, 2024

Christian Crumlish

"I know that a development team of six costs me a million bucks a year, so risk has a dollar value executives understand."

Christian Crumlish Wendy Johansson Rich Mironov Aditi Ruiz Adam Thomas

Afternoon Insights Panel

December 6, 2022

Crystal Yan

"A Slack bot that sends random customer quotes encourages ongoing learning and discovery."

Crystal Yan

Building a Customer-Centric Culture

March 30, 2020

Ron Bronson

"Friction can be good, especially when protecting private information."

Ron Bronson

Design, Consequences & Everyday Life

November 18, 2022

Kim Holt

"Our value of connection is brought to life through team offsites and weekly meetings with intentional moments to build connection."

Kim Holt Emma Wylds Pearl Koppenhaver Maisee Xiong

A Salesforce Panel Discussion on Values-Driven DesignOps

September 8, 2022

Nalini Kotamraju

"Conscious uncoupling is about identity — how one thinks of oneself defines oneself and how others define you."

Nalini Kotamraju

Research After UX

March 25, 2024

Rachael Dietkus, LCSW

"Authentically engaging with people traumatized by racism demands a significant abundance of care."

Rachael Dietkus, LCSW

Trauma-Responsive Design: Reimagining the Future of Design Now

December 10, 2021