Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
What happens when you cross an eager librarian, a happy puppy, and 800 UX experts? You get the Rosenbot—Rosenfeld's new GPT-4 level chatbot, trained on our books and hundreds of hours of conference and community call recordings. What went into creating the Rosenbot? Lou is joined by SimplyPut's Peter van Dijck, an old friend from the IA community and the chief architect of the Rosenbot. If you're beginning your journey into developing generative AI products, you'll want to join Lou and Peter to learn from their lessons, ask questions, and share your own thoughts on AI's role in making curated content more useful and impactful.
Key Insights
-
•
The Rosen bot uses curated, high-quality content from Rosenfeld Media to avoid common pitfalls of enterprise chatbots operating on messy internal data.
-
•
Significant project resources, around 30-50%, must be devoted to evaluation combining user tests, expert reviews, and repeatable automated metrics.
-
•
The chatbot intentionally avoids summarizing entire books to prevent cannibalizing book sales, instead acting as an entry point to authors’ original work.
-
•
Users and researchers often don’t know how they will use AI tools initially; the use cases evolve through interaction with the technology.
-
•
Building AI conversational agents requires embedding follow-up questions and memory simulation into the interaction design beyond a basic large language model.
-
•
Semantic search and topic analytics behind the scenes enable insights about conversation content trends and authors' influence in real time.
-
•
Balancing fresh, current content with older foundational material is challenging since methodologies and societal norms continually evolve.
-
•
There is a tension between jumping in to build and learn quickly versus cautious, deliberate product development; both parties in the talk appreciate different approaches.
-
•
Interactive UI elements like expandable answers and filters for broadening or narrowing responses are planned to enhance the conversational interface.
-
•
The Rosen bot acts as a creative companion and research assistant, helping accelerate idea exploration and uncover relevant historic knowledge efficiently.
Notable Quotes
"If you don’t jump in and learn, you’ll spend your time reading stuff on it and not really understand the tech."
"People forget the expertise every seven years and have to learn everything again—this bot helps make that expertise accessible."
"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."
"We devote 30 to 50 percent of the project time just on evaluation with real users and experts to ensure quality and safety."
"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."
"We’re building in the attribution of ideas to authors and speakers, emphasizing the humans behind the expertise."
"Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation."
"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."
"AI in design can act as a creative companion, helping explore ideas and analyze past research more efficiently."
"The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content."
Or choose a question:
More Videos
"AI products almost always have both open-ended inputs and outputs, which makes testing really hard."
Peter Van DijckBuilding impactful AI products for design and product leaders, Part 2: Evals are your moat
July 23, 2025
"Most people have a marketing or sales strategy, but many research leaders look puzzled when asked about their research strategy."
Chris Geison Cristen Torrey Eric MahlstedtWhat is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question
March 4, 2021
"Interactions are exposed as events on components, so you can define that on clicking a button, a dialog opens."
Jack BeharHow to Build Prototypes that Behave like an End-Product
December 6, 2022
"Think like a designer: approach how you build your team and scale your company’s product design practice like a design problem."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"Businesses are stripping down to skeleton crews and canceling anything that doesn't directly drive revenue."
Jon FukudaTheme One Intro
October 2, 2023
"Randomization is magic — it evenly distributes confounds so the observed effect is caused by your change."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
"Measuring wrong can cost you half a billion dollars, but also what you measure and how you measure matters a lot."
John Calhoun Rachel PosmanMeters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
September 24, 2024
"We love small teams because we move fast and break things and figure things out on the fly."
Jacqui Frey Dan WillisPanel Discussion: Integrating DesignOps
November 7, 2018
"Controls like insurance qualifiers and legal agreements were necessary guardrails for this new way of working."
Amy EvansHow to Create Change
September 25, 2024
