Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Enthusiasm for AI tools, especially large language models like ChatGPT, is everywhere, but what does it actually look like to deliver large-scale user-facing experiences using these tools in a production environment? Clearly they're powerful, but what do they need to make them work reliably and at scale? In this session, Sarah provides a perspective on some of the information architecture and user experience infrastructure organizations need to effectively leverage AI. She also shares three AI experiences currently live on Microsoft Learn: An interactive assistant that helps users post high-quality questions to a community forum A tool that dynamically creates learning plans based on goals the user shares A training assistant that clarifies, defines, and guides learners while they study Through lessons learned from shipping these experiences over the last two years, UXers, IAs, and PMs will come away with a better sense of what they might need to make these hyped-up technologies work in real life.
Key Insights
-
•
AI applications must not default to a generic everything chat bot; context and task specificity are crucial.
-
•
Building on a strong infrastructure reduces complexity in AI application development.
-
•
Evaluation should be a major component of AI development efforts; success cannot be gauged on anecdotal evidence.
-
•
Simplicity in tasks leads to higher success rates in AI applications; complex tasks are more challenging to manage.
-
•
User journeys should guide the development of AI features rather than an assumption they can handle everything.
-
•
Understanding task context can lower the ambiguity footprint of AI applications, thus improving usability.
-
•
Improving AI applications often requires organizations to first strengthen their foundational capabilities.
-
•
Visibility of AI interfaces matters; users must understand when and how AI is impacting their experience.
-
•
Dynamic context adds complexity, but can enhance the efficacy of AI tools when managed well.
-
•
A strong foundation in evaluation practices helps teams make informed decisions about AI model effectiveness.
Notable Quotes
"AI isn't the answer to all problems; it's about finding the right context for its use."
"We're not building the perfect model; we're improving the user experience within defined parameters."
"A chatbot is not a silver bullet; understanding user journeys is fundamentally important."
"The ambiguity footprint helps map the complexity of AI applications and the associated risks."
"It's critical to evaluate AI outputs; otherwise, we operate based on gut feelings."
"Ambiguity in AI development is inevitable, but we can manage it to improve our applications."
"When launching AI solutions, build complexity gradually to avoid overwhelming challenges."
"The stakes get higher with sensitive information, making context crucial in development."
"User engagement is more predictable when AI tools complement rather than interfere with tasks."
"Rigorous evaluation processes are as important in AI as they are in traditional product management."
More Videos
"The earlier you consider inclusion, the less costly it is."
Samuel ProulxInvisible barriers: Why accessible service design can’t be an afterthought
December 3, 2024
"If we begin to practice transformation as a way of life, it will be easier in our work."
Victor UdoewaTheme One Intro
March 27, 2023
"Integrating an ROI strategy means gaining credibility in early product development processes."
Gonzalo GoyanesDesign ROI: Cover a Little, Get a Lot
September 8, 2022
"Harms often accrue at the societal level rather than to individuals."
Alexandra SchmidtWhy Ethics Can't Save Tech
November 18, 2022
"If we don't create junior roles, we're going to lose potential talent."
Jose CoronadoFrom Zero to Hero
September 8, 2022
"All neurodiversity is unique and not one size fits all."
Pippa LomasPaving the Path for Neurodiversity in Design
October 4, 2023
"Communicating climate challenges is essential; we can't just focus on the doom and gloom."
Louis Rosenfeld Matt Jones Olga Khroustaleva Michael Leggett Karol MunozDo you want to work on climate? (Climate UX Discussion Series)
November 15, 2023
"The key is to align teams with business outcomes rather than project outputs."
Jeff GothelfThe Intersection of Lean and Design
January 10, 2019
"When we talk about success, we're not necessarily defining it; it’s often the businesses that don’t."
Dave GrayGroup Activity: Making Sense of DesignOps
November 7, 2017
