Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Friday, June 14, 2024 • Rosenfeld Community
Share the love for this talk
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Speakers: Peter Van Dijck and Louis Rosenfeld
Link:

Summary

What happens when you cross an eager librarian, a happy puppy, and 800 UX experts? You get the Rosenbot—Rosenfeld's new GPT-4 level chatbot, trained on our books and hundreds of hours of conference and community call recordings. What went into creating the Rosenbot? Lou is joined by SimplyPut's Peter van Dijck, an old friend from the IA community and the chief architect of the Rosenbot. If you're beginning your journey into developing generative AI products, you'll want to join Lou and Peter to learn from their lessons, ask questions, and share your own thoughts on AI's role in making curated content more useful and impactful.

Key Insights

  • The Rosen bot uses curated, high-quality content from Rosenfeld Media to avoid common pitfalls of enterprise chatbots operating on messy internal data.

  • Significant project resources, around 30-50%, must be devoted to evaluation combining user tests, expert reviews, and repeatable automated metrics.

  • The chatbot intentionally avoids summarizing entire books to prevent cannibalizing book sales, instead acting as an entry point to authors’ original work.

  • Users and researchers often don’t know how they will use AI tools initially; the use cases evolve through interaction with the technology.

  • Building AI conversational agents requires embedding follow-up questions and memory simulation into the interaction design beyond a basic large language model.

  • Semantic search and topic analytics behind the scenes enable insights about conversation content trends and authors' influence in real time.

  • Balancing fresh, current content with older foundational material is challenging since methodologies and societal norms continually evolve.

  • There is a tension between jumping in to build and learn quickly versus cautious, deliberate product development; both parties in the talk appreciate different approaches.

  • Interactive UI elements like expandable answers and filters for broadening or narrowing responses are planned to enhance the conversational interface.

  • The Rosen bot acts as a creative companion and research assistant, helping accelerate idea exploration and uncover relevant historic knowledge efficiently.

Notable Quotes

"If you don’t jump in and learn, you’ll spend your time reading stuff on it and not really understand the tech."

"People forget the expertise every seven years and have to learn everything again—this bot helps make that expertise accessible."

"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."

"We devote 30 to 50 percent of the project time just on evaluation with real users and experts to ensure quality and safety."

"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."

"We’re building in the attribution of ideas to authors and speakers, emphasizing the humans behind the expertise."

"Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation."

"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."

"AI in design can act as a creative companion, helping explore ideas and analyze past research more efficiently."

"The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Ian Johnson
Latent Scope: Finding structure in unstructured data
2025 • Designing with AI 2025
Gold
Brian Moss
What Does it Mean to be a Resilient Research Team?
2022 • Advancing Research 2022
Gold
Amy Jiménez Márquez
The Atypical UX Manager Path
2020 • Enterprise Community
Dan Donald
Design Systems as a Vehicle for Systemic Change
2023 • DesignOps Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Shipra Kayan
Make your research synthesis speedy and more collaborative using a canvas
2025 • Rosenfeld Community
Jen van der Meer
Service design performs value
2025 • Advancing Service Design 2025
Gold
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Melissa Eggleston
Practical People Skills for Building Trust on Teams and with Partners
2021 • Civic Design 2021
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Civic Design 2022
Gold
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold
Trisha Terhar
Empathizing with the Empowered: Non-Researcher Responses to Democratization
2022 • Advancing Research 2022
Gold
David Sternberg
Uncovering the hidden forces shaping user behavior
2025 • Rosenfeld Community
Cennydd Bowles
Responsible Design in Reality
2021 • Design at Scale 2021
Gold

More Videos

Christian Crumlish

"I know that a development team of six costs me a million bucks a year, so risk has a dollar value executives understand."

Christian Crumlish Wendy Johansson Rich Mironov Aditi Ruiz Adam Thomas

Afternoon Insights Panel

December 6, 2022

Michael Land

"There are lots of little mushroom patches of design sprouting up, but they're disconnected and not sharing."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Bria Alexander

"There’s no need to take notes. All session materials and videos will be shared quickly after presentations."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Surya Vanka

"Online, our bodies become transparent, reducing barriers and allowing for more intimate and open collaboration."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Cassandra Piester

"The most important step we often forget is moving on to the next problem."

Cassandra Piester

Developing and Deploying Your Design Operations Strategy

September 24, 2024

Ariel Kennan

"We’ll explore tactics to understand systems, points of intervention, and how to redirect power."

Ariel Kennan

Theme 2 Intro

December 9, 2021

Joshua Graves

"Our brains are wired for efficiency and use heuristics, so they prefer daydreaming over hard conversations."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Peter Van Dijck

"All the complicated-sounding techniques are just ways to put the relevant text into the context window."

Peter Van Dijck

Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!

July 30, 2025

Bria Alexander

"If you are a cohort participant and don’t see your private Slack channel, please let us know so we can guide you."

Bria Alexander

Opening Remarks

November 17, 2022