Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scale Smart: AI-Powered Content Organization Strategies

Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Scale Smart: AI-Powered Content Organization Strategies
Speakers: Jorge Arango
Link:

Summary

Keeping large content repositories organized is an ongoing challenge. There's always new stuff coming in, and taxonomies evolve over time. Resource-strapped teams seldom have opportunities to re-categorize older content. It's a task well-suited for generative AI. Large language models have powerful capabilities that can help teams keep content organized at scale. Using LLMs in this capacity can lead to better user experiences and free team members to focus on more valuable efforts. This presentation explores two approaches for using LLMs to organize content at scale: 1) re-categorizing content using existing categories and 2) developing new categories from existing content. Both will be shown as proofs of concept alongside feasible next steps.

Key Insights

  • Maintaining organized large content repositories is often deprioritized despite evolving product portfolios, leading to reduced findability.

  • Search alone is insufficient for large repositories because users often lack context about what content exists.

  • Evolving taxonomies require periodic retagging of older content to keep it relevant and findable.

  • AI, specifically large language models like GPT-4, can automate taxonomy maintenance tasks significantly faster than humans.

  • Human oversight is critical to review AI-suggested tags to prevent hallucinations and ensure quality.

  • Developing new taxonomies requires analyzing content holistically, which exceeds typical LLM context windows.

  • Embedding databases help chunk and relate content statistically for clustering similar topics at scale.

  • Graph Retrieval Augmented Generation (Graph RAG) integrates knowledge graphs with LLMs to increase precision by leveraging semantic relationships.

  • RAG enables querying domain-specific content unseen by generic LLM training data, supporting bespoke AI assistants.

  • AI tools enable higher speed and new methods for content work but require new workflows and ongoing experimentation.

Notable Quotes

"Keeping large content repositories organized is an ongoing challenge that often gets deprioritized."

"Search alone doesn’t cut it, particularly when people don’t know what they’re looking for or lack context."

"If organizations don’t keep content organized, it becomes less usable and less useful over time."

"Large language models can help organize content faster and at much larger scale than people can."

"I used GPT-4 to retag 1,200 blog posts, reducing an estimated 10–12 hours of tedious manual work to about a third of that time."

"I made sure the LLM would only use terms from my predefined taxonomy, but it still introduced some of its own tags."

"Working with these tools requires new workflows and checkpoints to validate and tweak the AI's output."

"Graph RAG uses knowledge graphs instead of just plain text snippets, which really improves precision."

"I see these AI tools as augmenting human work, letting us focus on what matters most, not replacing humans."

"The best way to understand these technologies is to learn them hands-on, especially if your work involves language or taxonomies."

Ask the Rosenbot
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community
Billy Carlson
Principles of Team Wireframing
2023 • DesignOps Summit 2023
Gold
Mark Templeton
Creating a Legacy: the ultimate experience
2017 • Enterprise Experience 2017
Gold
Dan Willis
Enterprise Storytelling Sessions
2018 • Enterprise Experience 2018
Gold
Dave Malouf
Closing Keynote: Amplify. Not Optimize.
2019 • DesignOps Summit 2019
Gold
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • Design at Scale 2021
Gold
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold
Vanessa Varin
Tools are moments. Capabilities compound.
2026 • Designing with AI 2026
Conference
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Mark Boulton
Ops without Designers
2018 • DesignOps Summit 2018
Gold
Dr. Jamika D. Burge
Bridge Building across Research Disciplines
2021 • Advancing Research Community
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young
2019 • Advancing Research Community
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Jake Burghardt
Finding More Inroads into Research Impact
2026 • Rosenfeld Community

More Videos

Laine Riley Prokay

"Relationship design is not just what you do but how you do it, focusing on building relationships with customers, employees, and community."

Laine Riley Prokay

How DesignOps can Drive Inclusive Career Ladders for All

September 30, 2021

Victor Udoewa

"Community-rooted wisdom like the Mexican 'guana' practice reduces postpartum depression without traditional research."

Victor Udoewa

Beyond Methods and Diversity: The Roots of Inclusion

March 26, 2024

Husani Oakley

"How AI is built and used impacts the human experience at the other end of the screen."

Husani Oakley

Theme Three Intro

June 6, 2023

Jess Greco

"Connecting the skills inventory to the career framework was crucial to getting buy-in across functions."

Jess Greco

Creating a Basis for Change: Scaling Design Maturity

June 8, 2022

Shipra Kayan

"How can we make research keep up with the speed of changes in the business?"

Shipra Kayan

Make your research synthesis speedy and more collaborative using a canvas

January 24, 2025

Prayag Narula

"If you are building a product for someone, there's always context loss when problem identification and solutioning are done by different teams."

Prayag Narula Abhinav Krishna

Dialing for Research: How to Reach the Unreachable

March 10, 2022

Sam Proulx

"Getting accessibility integrated into all company processes is essential because accessibility is a culture change."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Amy Evans

"Would you feel confident leaving your project success to the flip of a coin based on the fact that almost half of all change fails?"

Amy Evans

How to Create Change

September 25, 2024

Greg Petroff

"We’re entering a world where design is going to be core to strategy and where making will become thinking."

Greg Petroff

Everything is About to Change: Software as Material

June 8, 2016