Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Integrating generative AI into enterprise products: A case study from dscout
Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
Integrating generative AI into enterprise products: A case study from dscout
Speakers: Jonathan Fairman and Kevin Johnson
Link:

Summary

Join dscout for an in-depth case study walking through a first-year journey of integrating Generative AI into an established enterprise product. In a session tailored specifically for product teams, the speakers will delve into the paradigm shifts in UX professionals to technical relationships, strategies, and processes. dscout’s Jonathan Fairman, VP of Product, and Kevin Johnson, Head of AI, will discuss how the stochastic nature of AI technologies led to the move of a piloting approach to development and traditional wireframe testing of concepts no longer possible.

Key Insights

  • Building AI products requires giving up control over the product's behavior due to the unpredictable nature of LLMs.

  • Traditional usability testing assumptions break down with AI because each user experience dynamically diverges after the first interaction.

  • Longitudinal testing is critical for AI products to understand how user relationships with models evolve over time.

  • Wizard of Oz testing (humans simulating AI) is a low-cost method to validate assumptions before building complex AI models.

  • Model drift in LLMs causes unpredictable and sometimes harmful behavior, necessitating turn-capping or memory features to maintain consistency.

  • Users build their mental models for AI assistants dynamically while using them, unlike fixed software products.

  • The stochastic nature of AI results means identical commands can produce different outcomes, affecting user mastery and trust.

  • Multi-dimensional prioritization frameworks, like importance vs. difficulty, help teams align on assumptions to test first in AI product development.

  • Recognizing failure as inevitable and building failure metrics accelerates learning and innovation in generative AI.

  • Humans will retain roles centered on creativity, critical thinking, accountability, and authenticity in a future transformed by AI.

Notable Quotes

"Building on AI means giving up control, which is tough but necessary."

"If the folks who design LLMs don’t know exactly how they work, it’s okay if you don’t either."

"The product is no longer fixed; after the first interaction, it diverges user by user."

"We’re not studying products anymore; we’re studying experiences in ecosystems."

"Failure is inevitable—if you’re right all the time, you’re not taking big enough swings."

"Users are building mental models of how to use AI while they’re using it."

"Testing AI products requires longitudinal methods to see how relationships and experiences evolve."

"Wizard of Oz testing with humans playing bots can reveal insights without building a full model."

"Asynchronous conversations have nested threads humans track easily but are hard for bots to replicate."

"Creativity, accountability, and authenticity will be the new markers of humanity alongside AI."

Ask the Rosenbot
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Kate Towsey
The State of ResearchOps: More Than Just Theory
2019 • DesignOps Community
Heidi Trost
To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity
2025 • Rosenfeld Community
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Laura Klein
Unique challenges of innovation in enterprises
2020 • Enterprise Community
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Dan Willis
Enterprise Storytelling Sessions
2016 • Enterprise UX 2016
Gold
Megan Nipe
Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging
2021 • Civic Design 2021
Gold
Sean Fitzell
Craft of User Research: Building Out Jobs to be Done Maps
2021 • Advancing Research 2021
Gold
Kate Towsey
Ask Me Anything (AMA) with Kate Towsey
2025 • Rosenfeld Community
Deirdre Hirschtritt
Research is Only as Good as the Relationships You Build
2022 • Civic Design 2022
Gold
Nathan Curtis
Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough?
2019 • DesignOps Community

More Videos

Ignacio Martinez

"Our evaluation tool is a Google Sheet so we can quickly make adjustments without being bogged down by unnecessary features."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Amelia Cole

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

Amelia Cole

Data-Prompted Interviews

December 17, 2021

Kristin Skinner

"When you think about change, there’s pushing to help people get through, pulling to bring people along, and then just letting it happen."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Billy Carlson

"Staying in low fidelity throughout this early concept development phase allows for really strict focus on the problem slash solution space."

Billy Carlson

Tips to Utilize Wireframes to Tell an Effective Product Story

June 6, 2023

Yolanda Rankin

"Technology can be used for harm, like facial recognition systems misidentifying people of color as criminals."

Yolanda Rankin

Black Feminist Epistemology as a Critical Framework for Equitable Design

March 11, 2021

Eduardo Ortiz

"How do we empower others to perform research by becoming coaches?"

Eduardo Ortiz

Theme 3 Intro

March 13, 2025

Toby Haug

"Invite support people to scrums or monthly engineering reviews so design can get visibility into common customer issues."

Toby Haug

Discussion

June 9, 2017

Joseph Meersman

"People were sweating their pixels, but doing so inside of solos and personal barriers until we started critiquing transparently together."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Bob Baxley

"Designers have different minds, like organic computers, each tuned to solve different parts of the problem."

Bob Baxley

Leading with Design Operations Past and Present

December 19, 2019