Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

[Demo] How to re-categorize content at scale using LLMs
Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
[Demo] How to re-categorize content at scale using LLMs
Speakers: Jorge Arango
Link:

Summary

Large Language Models (LLMs) are to language as spreadsheets are to numbers: tools for modeling, exploration, and development. Among their many capabilities, LLMs can alleviate chores related to the design and implementation of information architectures. But doing so requires venturing beyond chat-based interfaces. In this brief demonstration, we'll see how to use OpenAI's API and a few open source command line tools to re-categorize content in a 1,000+ page website. The techniques demonstrated can be extended to other common content organization tasks.

Key Insights

  • The discoverability of older content on blogs is often a challenge, making accurate tagging essential.

  • LLMs like GPT-4 can significantly reduce the manual workload involved in organizing content.

  • A structured approach to task automation can be effectively implemented using a four-step framework.

  • Having a clean, obvious taxonomy is crucial for successful AI interaction and content tagging.

  • Reviewing AI-generated changes before implementation is necessary to ensure accuracy and relevance.

  • AI can provide valuable insights, potentially improving existing classification systems.

  • LLMs can function as both a tagging assistant and a surveyor of content relevance.

  • Automation can save considerable time and effort, exemplifying the potential of AI in daily tasks.

  • This process can be scaled to various content management systems beyond static site generators.

  • Engaging with the community for feedback can enhance AI implementation experiences.

Notable Quotes

"I'm an information architect, which means that I organize websites and apps to make stuff easier to find and understand."

"This is a case study on one such toil that I've been removing using LLMs."

"The more recent stuff gets more attention and the older stuff has discoverability problems."

"The first step is gathering the information and the second step is reviewing the changes that the LLM is proposing to make."

"I had to clean this taxonomy up, and I eliminated terms like TAOI."

"GPT actually functioned as an assistant, not just in retagging things, but also in the taxonomy itself."

"It took about three hours from beginning to end to do this, and I was only involved in about two of those hours."

"Be open to contributions; the LLM might help improve your taxonomy."

"I expect that this process is scalable across other systems."

"Good luck as you venture into this wild new world."

More Videos

Samuel Proulx

"Disability isn't a problem with a person; it's about the systems and environments we create."

Samuel Proulx

Invisible barriers: Why accessible service design can’t be an afterthought

December 3, 2024

Victor Udoewa

"Transformation becomes more alive in times of great upheaval."

Victor Udoewa

Theme One Intro

March 27, 2023

Gonzalo Goyanes

"Promoting design means business growth and that's great; it's been proven to work."

Gonzalo Goyanes

Design ROI: Cover a Little, Get a Lot

September 8, 2022

Alexandra Schmidt

"It's important for designers to rethink their savior complex."

Alexandra Schmidt

Why Ethics Can't Save Tech

November 18, 2022

Jose Coronado

"Design operations is a process improvement and change management culture change."

Jose Coronado

From Zero to Hero

September 8, 2022

Pippa Lomas

"For our onboarding, we gathered formal feedback from starters."

Pippa Lomas

Paving the Path for Neurodiversity in Design

October 4, 2023

Louis Rosenfeld

"Every job is a climate job, and we should all be looking for ways to contribute."

Louis Rosenfeld Matt Jones Olga Khroustaleva Michael Leggett Karol Munoz

Do you want to work on climate? (Climate UX Discussion Series)

November 15, 2023

Jeff Gothelf

"Highlighting productivity gaps can shed light on the counterproductive nature of under-resourcing design."

Jeff Gothelf

The Intersection of Lean and Design

January 10, 2019

Dave Gray

"We gotta sit through two hours a day of gray; the answer is no, you don't have to sit through two hours."

Dave Gray

Group Activity: Making Sense of DesignOps

November 7, 2017