Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scale Smart: AI-Powered Content Organization Strategies

Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Scale Smart: AI-Powered Content Organization Strategies
Speakers: Jorge Arango
Link:

Summary

Keeping large content repositories organized is an ongoing challenge. There's always new stuff coming in, and taxonomies evolve over time. Resource-strapped teams seldom have opportunities to re-categorize older content. It's a task well-suited for generative AI. Large language models have powerful capabilities that can help teams keep content organized at scale. Using LLMs in this capacity can lead to better user experiences and free team members to focus on more valuable efforts. This presentation explores two approaches for using LLMs to organize content at scale: 1) re-categorizing content using existing categories and 2) developing new categories from existing content. Both will be shown as proofs of concept alongside feasible next steps.

Key Insights

  • Maintaining organized large content repositories is often deprioritized despite evolving product portfolios, leading to reduced findability.

  • Search alone is insufficient for large repositories because users often lack context about what content exists.

  • Evolving taxonomies require periodic retagging of older content to keep it relevant and findable.

  • AI, specifically large language models like GPT-4, can automate taxonomy maintenance tasks significantly faster than humans.

  • Human oversight is critical to review AI-suggested tags to prevent hallucinations and ensure quality.

  • Developing new taxonomies requires analyzing content holistically, which exceeds typical LLM context windows.

  • Embedding databases help chunk and relate content statistically for clustering similar topics at scale.

  • Graph Retrieval Augmented Generation (Graph RAG) integrates knowledge graphs with LLMs to increase precision by leveraging semantic relationships.

  • RAG enables querying domain-specific content unseen by generic LLM training data, supporting bespoke AI assistants.

  • AI tools enable higher speed and new methods for content work but require new workflows and ongoing experimentation.

Notable Quotes

"Keeping large content repositories organized is an ongoing challenge that often gets deprioritized."

"Search alone doesn’t cut it, particularly when people don’t know what they’re looking for or lack context."

"If organizations don’t keep content organized, it becomes less usable and less useful over time."

"Large language models can help organize content faster and at much larger scale than people can."

"I used GPT-4 to retag 1,200 blog posts, reducing an estimated 10–12 hours of tedious manual work to about a third of that time."

"I made sure the LLM would only use terms from my predefined taxonomy, but it still introduced some of its own tags."

"Working with these tools requires new workflows and checkpoints to validate and tweak the AI's output."

"Graph RAG uses knowledge graphs instead of just plain text snippets, which really improves precision."

"I see these AI tools as augmenting human work, letting us focus on what matters most, not replacing humans."

"The best way to understand these technologies is to learn them hands-on, especially if your work involves language or taxonomies."

Ask the Rosenbot
Jess Greco
Creating a Basis for Change: Scaling Design Maturity
2022 • Design at Scale 2022
Gold
Peter Merholz
Customer-Centered Design Organizations
2017 • Enterprise Experience 2017
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
John Donmoyer
Shipping your code generation experiments to production
2025 • Designing with AI 2025
Gold
Feleesha Sterling
Building a Rapid Research Program
2023 • Enterprise Community
Louis Rosenfeld
About the Rosenverse
2026 • Rosenfeld Community
John Cutler
The Alignment Trap
2023 • Design in Product 2023
Gold
Bria Alexander
Day 3 Welcome
2024 • DesignOps Summit 2024
Gold
Louis Rosenfeld
Founder’s Welcome
2022 • Design in Product 2022
Gold
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Cheryl Platz
Embrace Your Fun Factor: Game Development Best Practices for Product Design
2026 • Rosenfeld Community
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Mike Oren
Design Research Strategy & Strategic Design Research
2022 • Advancing Research Community
PJ Buddhari
Meet Spectrum, Adobe’s Design System
2021 • Design at Scale 2021
Gold

More Videos

Maria Giudice

"The only way you’re going to go from good to great is through well-crafted experiences."

Maria Giudice

Remaking the Making Company: Moving from Product to Experience

June 9, 2016

Christian Crumlish

"Leadership doesn’t necessarily mean managing people; it means scaling impact through teaching, training, and setting examples."

Christian Crumlish

AMA with Christian Crumlish, author of Product Management for UX People

March 24, 2022

Rima Campbell

"AI makes data more accessible to everyone but won’t replace the need for validated, empathetic UX research."

Rima Campbell Amrit S Bhachu

Increase Productivity and Drive Business Impact

September 24, 2024

Sam Proulx

"Accessibility needs are a spectrum, not binary."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

June 10, 2022

Victor Udoewa

"Facilitation is powered; power is exercised in the spaces between workshops without community presence."

Victor Udoewa

Radical Participatory Design: Decolonizing Participatory Design Processes

December 10, 2021

Jon Fukuda

"If design, product, and development use different tools, we end up talking past one another."

Jon Fukuda Amy Evans Ignacio Martinez Joe Meersman

The Big Question about Innovation: A Panel Discussion

September 25, 2024

Rachael Dietkus, LCSW

"Trauma is a rupture in meaning making; the way you see yourself, the world and others is shocked and overturned by an event."

Rachael Dietkus, LCSW

Trauma-Responsive Design: Reimagining the Future of Design Now

December 10, 2021

Kyria Stephens

"Gunshots were a routine sound growing up. We became numb to it."

Kyria Stephens Marlon Kerner

Power to Heal: Civic Design in the Aftermath of Tragedy

November 17, 2022

Niko Laitinen

"People were pushed but had no idea what was expected from them — adaptability was lacking."

Niko Laitinen

Adaptable Org Design for Resilient Times

June 10, 2021