Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Friday, June 14, 2024 • Rosenfeld Community
Share the love for this talk
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Speakers: Peter Van Dijck and Louis Rosenfeld
Link:

Summary

What happens when you cross an eager librarian, a happy puppy, and 800 UX experts? You get the Rosenbot—Rosenfeld's new GPT-4 level chatbot, trained on our books and hundreds of hours of conference and community call recordings. What went into creating the Rosenbot? Lou is joined by SimplyPut's Peter van Dijck, an old friend from the IA community and the chief architect of the Rosenbot. If you're beginning your journey into developing generative AI products, you'll want to join Lou and Peter to learn from their lessons, ask questions, and share your own thoughts on AI's role in making curated content more useful and impactful.

Key Insights

  • The Rosen bot uses curated, high-quality content from Rosenfeld Media to avoid common pitfalls of enterprise chatbots operating on messy internal data.

  • Significant project resources, around 30-50%, must be devoted to evaluation combining user tests, expert reviews, and repeatable automated metrics.

  • The chatbot intentionally avoids summarizing entire books to prevent cannibalizing book sales, instead acting as an entry point to authors’ original work.

  • Users and researchers often don’t know how they will use AI tools initially; the use cases evolve through interaction with the technology.

  • Building AI conversational agents requires embedding follow-up questions and memory simulation into the interaction design beyond a basic large language model.

  • Semantic search and topic analytics behind the scenes enable insights about conversation content trends and authors' influence in real time.

  • Balancing fresh, current content with older foundational material is challenging since methodologies and societal norms continually evolve.

  • There is a tension between jumping in to build and learn quickly versus cautious, deliberate product development; both parties in the talk appreciate different approaches.

  • Interactive UI elements like expandable answers and filters for broadening or narrowing responses are planned to enhance the conversational interface.

  • The Rosen bot acts as a creative companion and research assistant, helping accelerate idea exploration and uncover relevant historic knowledge efficiently.

Notable Quotes

"If you don’t jump in and learn, you’ll spend your time reading stuff on it and not really understand the tech."

"People forget the expertise every seven years and have to learn everything again—this bot helps make that expertise accessible."

"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."

"We devote 30 to 50 percent of the project time just on evaluation with real users and experts to ensure quality and safety."

"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."

"We’re building in the attribution of ideas to authors and speakers, emphasizing the humans behind the expertise."

"Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation."

"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."

"AI in design can act as a creative companion, helping explore ideas and analyze past research more efficiently."

"The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content."

Ask the Rosenbot
Kim Lenox
Leading Distributed Global Teams
2019 • Enterprise Community
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold
Tricia Wang
From Users to Shapers of AI: The Future of Research
2024 • Advancing Research 2024
Gold
Mansi Gupta
Women-Centric Research: What, Why, How
2023 • Advancing Research 2023
Gold
Megan Blocker
What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Megan Nipe
Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging
2021 • Civic Design 2021
Gold
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
Samuel Proulx
Designing for Disability, Innovating for Everyone
2025 • Advancing Research 2025
Gold
Maggie Dieringer
Creating Consistency Through Constant Change
2024 • DesignOps Summit 2020
Gold
Steve Portigal
War Stories LIVE! Steve Portigal
2020 • Advancing Research 2020
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Christopher Taylor Edwards
Design as a Team Practice, A Practical Guide to Cross-functional Collaboration
2021 • DesignOps Summit 2021
Gold
Sarah Barrett
The "How" of Enterprise Information Architecture
2023 • Enterprise UX 2023
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Séamus Byrne
Aligning Teams with Choreography
2024 • Enterprise Experience 2020
Gold
Matt Stone
Scaling Empathy, A Case Study in Change Management
2021 • Design at Scale 2021
Gold

More Videos

Nalini Kotamraju

"We made this move in January 2020 — our research and insights team moved out of UX but stayed within product organizations."

Nalini Kotamraju

Research After UX

March 25, 2024

Dean Broadley

"When crabs shed their shells, they're vulnerable, so they gather in safe groups for protection."

Dean Broadley

Not Black Enough to be White

January 8, 2024

Denise Jacobs

"We’re not going for perfection. We’re going for excellence and change."

Denise Jacobs Nancy Douyon Renee Reid Lisa Welchman

Interactive Keynote: Social Change by Design

January 8, 2024

Kim Fellman Cohen

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

Kim Fellman Cohen

Measuring the Designer Experience

October 23, 2019

George Aye

"Saying no shouldn’t be about being difficult but about accountability beyond any one person."

George Aye

That Quiet Little Voice: When Design and Ethics Collide

November 16, 2022

Nathan Curtis

"Don’t just think about design systems as an artifact but as a living ecosystem connecting people, tools, and products."

Nathan Curtis

Beyond the Toolkit: Spreading a System Across People & Products

June 9, 2016

Greg Petroff

"There is an enormous amount of diversity in the real estate agent community, from demographics to technology savvy to regional differences."

Greg Petroff

The Compass Mission

March 10, 2021

Chloe Amos-Edkins

"Traditional design thinking and human-centered design rarely take localized nuances and global trends into account."

Chloe Amos-Edkins

A Cultural Approach: Research in the Context of Glocalisation

March 27, 2023

Mackenzie Cockram

"We are not collecting vanity analytics, the data is doing real work on informing design."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022