Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scale Smart: AI-Powered Content Organization Strategies
Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Scale Smart: AI-Powered Content Organization Strategies
Speakers: Jorge Arango
Link:

Summary

Keeping large content repositories organized is an ongoing challenge. There's always new stuff coming in, and taxonomies evolve over time. Resource-strapped teams seldom have opportunities to re-categorize older content. It's a task well-suited for generative AI. Large language models have powerful capabilities that can help teams keep content organized at scale. Using LLMs in this capacity can lead to better user experiences and free team members to focus on more valuable efforts. This presentation explores two approaches for using LLMs to organize content at scale: 1) re-categorizing content using existing categories and 2) developing new categories from existing content. Both will be shown as proofs of concept alongside feasible next steps.

Key Insights

  • Maintaining organized large content repositories is often deprioritized despite evolving product portfolios, leading to reduced findability.

  • Search alone is insufficient for large repositories because users often lack context about what content exists.

  • Evolving taxonomies require periodic retagging of older content to keep it relevant and findable.

  • AI, specifically large language models like GPT-4, can automate taxonomy maintenance tasks significantly faster than humans.

  • Human oversight is critical to review AI-suggested tags to prevent hallucinations and ensure quality.

  • Developing new taxonomies requires analyzing content holistically, which exceeds typical LLM context windows.

  • Embedding databases help chunk and relate content statistically for clustering similar topics at scale.

  • Graph Retrieval Augmented Generation (Graph RAG) integrates knowledge graphs with LLMs to increase precision by leveraging semantic relationships.

  • RAG enables querying domain-specific content unseen by generic LLM training data, supporting bespoke AI assistants.

  • AI tools enable higher speed and new methods for content work but require new workflows and ongoing experimentation.

Notable Quotes

"Keeping large content repositories organized is an ongoing challenge that often gets deprioritized."

"Search alone doesn’t cut it, particularly when people don’t know what they’re looking for or lack context."

"If organizations don’t keep content organized, it becomes less usable and less useful over time."

"Large language models can help organize content faster and at much larger scale than people can."

"I used GPT-4 to retag 1,200 blog posts, reducing an estimated 10–12 hours of tedious manual work to about a third of that time."

"I made sure the LLM would only use terms from my predefined taxonomy, but it still introduced some of its own tags."

"Working with these tools requires new workflows and checkpoints to validate and tweak the AI's output."

"Graph RAG uses knowledge graphs instead of just plain text snippets, which really improves precision."

"I see these AI tools as augmenting human work, letting us focus on what matters most, not replacing humans."

"The best way to understand these technologies is to learn them hands-on, especially if your work involves language or taxonomies."

Ask the Rosenbot
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops
2022 • Advancing Research Community
Satyam Kantamneni
Do You Have an Experience Vision?
2023 • Enterprise Community
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Ash Brown
Silver Linings: What DesignOps Learned in the Shift to WFH
2020 • DesignOps Summit 2020
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Bud Caddell
Theme 2 Intro
2021 • DesignOps Summit 2021
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Samuel Proulx
Designing for Disability, Innovating for Everyone
2025 • Advancing Research 2025
Gold
Wendy Johansson
Be a Product Boss!
2022 • Design in Product 2022
Gold
Mariah Hay
Ethics in Tech Education: Designing to Provide Opportunity for All
2018 • Enterprise Experience 2018
Gold
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Matt Bernius
Learnings from Applying Trauma-Informed Principles to the Research Process
2022 • Advancing Research 2022
Gold
Joseph Williams
Unlocking impact and influence through inclusive hiring in research
2021 • Advancing Research Community
Kim Lenox
Leading Distributed Global Teams
2019 • Enterprise Community
Cheryl Platz
Collaborative Creativity through Improv
2018 • DesignOps Summit 2018
Gold

More Videos

John Cutler

"A story lets people assign the meaning that's powerful to them and then think about the decisions they need to make and align."

John Cutler

The Alignment Trap

November 29, 2023

Monty Hammontree

"If you get enough good behavior going on, the system corrects itself and susses out the bad."

Monty Hammontree

The Future of UX Research

December 3, 2020

Matt Stone

"I didn’t understand the people who would be using it, so it was not received well and shut down quickly."

Matt Stone

Scaling Empathy, A Case Study in Change Management

June 11, 2021

Gonzalo Goyanes

"Our aim is not just to demonstrate design’s value for growth, but to become an essential part of the company’s overall strategy."

Gonzalo Goyanes

Design ROI: Cover a Little, Get a Lot

September 8, 2022

Amy Parness

"People don’t come to the site just to read about ESG goals; they want customer-facing information they can apply."

Amy Parness

Scaling Sustainability: Complementary strategies that drive long-term success

May 29, 2025

Alana Washington

"John Calhoun is going to talk to us about reaching our peak and figuring out if we’ve reached our peak and how to find the next one."

Alana Washington

Theme 3 Intro

October 1, 2021

Patrizia Bertini

"Machines cannot be accountable; responsibility is always human."

Patrizia Bertini

Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation

December 11, 2025

Jane Reid

"If you’re not okay as a researcher, the interview won’t be okay."

Jane Reid Janice Hannaway

Self-care in User Research

April 2, 2020

Nathan Curtis

"Visual style isn’t just enough to make something feel cohesive."

Nathan Curtis

Beyond the Toolkit: Spreading a System Across People & Products

June 9, 2016