Rosenverse
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Friday, June 14, 2024 • Rosenfeld Community
Share the love for this talk
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Speakers: Peter Van Dijck and Louis Rosenfeld
Link:

Summary

What happens when you cross an eager librarian, a happy puppy, and 800 UX experts? You get the Rosenbot—Rosenfeld's new GPT-4 level chatbot, trained on our books and hundreds of hours of conference and community call recordings. What went into creating the Rosenbot? Lou is joined by SimplyPut's Peter van Dijck, an old friend from the IA community and the chief architect of the Rosenbot. If you're beginning your journey into developing generative AI products, you'll want to join Lou and Peter to learn from their lessons, ask questions, and share your own thoughts on AI's role in making curated content more useful and impactful.

Key Insights

  • The Rosen bot uses curated, high-quality content from Rosenfeld Media to avoid common pitfalls of enterprise chatbots operating on messy internal data.

  • Significant project resources, around 30-50%, must be devoted to evaluation combining user tests, expert reviews, and repeatable automated metrics.

  • The chatbot intentionally avoids summarizing entire books to prevent cannibalizing book sales, instead acting as an entry point to authors’ original work.

  • Users and researchers often don’t know how they will use AI tools initially; the use cases evolve through interaction with the technology.

  • Building AI conversational agents requires embedding follow-up questions and memory simulation into the interaction design beyond a basic large language model.

  • Semantic search and topic analytics behind the scenes enable insights about conversation content trends and authors' influence in real time.

  • Balancing fresh, current content with older foundational material is challenging since methodologies and societal norms continually evolve.

  • There is a tension between jumping in to build and learn quickly versus cautious, deliberate product development; both parties in the talk appreciate different approaches.

  • Interactive UI elements like expandable answers and filters for broadening or narrowing responses are planned to enhance the conversational interface.

  • The Rosen bot acts as a creative companion and research assistant, helping accelerate idea exploration and uncover relevant historic knowledge efficiently.

Notable Quotes

"If you don’t jump in and learn, you’ll spend your time reading stuff on it and not really understand the tech."

"People forget the expertise every seven years and have to learn everything again—this bot helps make that expertise accessible."

"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."

"We devote 30 to 50 percent of the project time just on evaluation with real users and experts to ensure quality and safety."

"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."

"We’re building in the attribution of ideas to authors and speakers, emphasizing the humans behind the expertise."

"Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation."

"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."

"AI in design can act as a creative companion, helping explore ideas and analyze past research more efficiently."

"The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content."

Ask the Rosenbot
Harry Max
Priority Zero: Some Things are More Equal than Others
2016 • Enterprise UX 2016
Gold
Patrizia Bertini
Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
2025 • DesignOps Community
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
2020 • Advancing Research Community
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Meghan Hellstern
The Next 100 Years of Civic Design: How Might We Better Rise to Meet the Challenges of Today and Tomorrow?
2021 • Civic Design 2021
Gold
Erin Hoffman-John
This Game is Never Done: Design Leadership Techniques from the Video Game World
2017 • DesignOps Summit 2017
Gold
Daniel Gloyd
Transcendent Experience (ZX) Design: A Design Framework for Human Connection
2026 • Rosenfeld Community
James Wieselman Schulman
Research is a team sport: advancing the work when everyone does the research
2026 • Advancing Research 2026
Gold
Marina Martin
Lives on the Line: The Stakes of UX at the Scale of Government
2018 • Enterprise Experience 2018
Gold
Tim Frick
The journey of building a sustainable design practice
2025 • Climate UX Interest Group
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Russ Unger
Onboarding: The Ecosystem, not the Afterthought
2017 • DesignOps Summit 2017
Gold

More Videos

Darian Davis

"A common toxic behavior is glory seeking, like presenting work as your own when it was a team effort."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Indi Young

"Demographics don’t cause thinking; past experiences, personal rules, and emotions do."

Indi Young

Thinking styles: Mend hidden cracks in your market

January 8, 2025

Louis Rosenfeld

"If you want to make this conference better for you, just let us know in Slack — we want you to have a positive experience."

Louis Rosenfeld Bria Alexander

Day 1 Welcome

September 23, 2024

Melissa Schmidt

"We created simple report templates to help people who have never done research before share their insights."

Melissa Schmidt Adam Menter

How UX Research Hit It Big in Las Vegas

June 4, 2019

Kristin Skinner

"In many cases, we don’t even know what the work is in design ops."

Kristin Skinner Kamdyn Moore

8 Types of Measures in Design Operations

April 16, 2020

Dave Hora

"If research findings aren’t connected to action, then you’re just planning and not actually doing strategy."

Dave Hora

Advice for Establishing Research

December 8, 2022

Sean Fitzell

"While we love Guy Fieri, we prefer to watch him on Food Network and not experience our own version of Triple D any longer."

Sean Fitzell Sarah Han Kayla Farrell

Craft of User Research: Building Out Jobs to be Done Maps

March 12, 2021

Jason Mesut

"Just assume we haven’t read it and keep it quick."

Jason Mesut

Shaping design, designers and teams

November 8, 2018

Dante Guintu

"The pandemic flipped the equation, and IBM became the place that design talent left."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022