Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

[Demo] How to re-categorize content at scale using LLMs
Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
[Demo] How to re-categorize content at scale using LLMs
Speakers: Jorge Arango
Link:

Summary

Large Language Models (LLMs) are to language as spreadsheets are to numbers: tools for modeling, exploration, and development. Among their many capabilities, LLMs can alleviate chores related to the design and implementation of information architectures. But doing so requires venturing beyond chat-based interfaces. In this brief demonstration, we'll see how to use OpenAI's API and a few open source command line tools to re-categorize content in a 1,000+ page website. The techniques demonstrated can be extended to other common content organization tasks.

Key Insights

  • The discoverability of older content on blogs is often a challenge, making accurate tagging essential.

  • LLMs like GPT-4 can significantly reduce the manual workload involved in organizing content.

  • A structured approach to task automation can be effectively implemented using a four-step framework.

  • Having a clean, obvious taxonomy is crucial for successful AI interaction and content tagging.

  • Reviewing AI-generated changes before implementation is necessary to ensure accuracy and relevance.

  • AI can provide valuable insights, potentially improving existing classification systems.

  • LLMs can function as both a tagging assistant and a surveyor of content relevance.

  • Automation can save considerable time and effort, exemplifying the potential of AI in daily tasks.

  • This process can be scaled to various content management systems beyond static site generators.

  • Engaging with the community for feedback can enhance AI implementation experiences.

Notable Quotes

"I'm an information architect, which means that I organize websites and apps to make stuff easier to find and understand."

"This is a case study on one such toil that I've been removing using LLMs."

"The more recent stuff gets more attention and the older stuff has discoverability problems."

"The first step is gathering the information and the second step is reviewing the changes that the LLM is proposing to make."

"I had to clean this taxonomy up, and I eliminated terms like TAOI."

"GPT actually functioned as an assistant, not just in retagging things, but also in the taxonomy itself."

"It took about three hours from beginning to end to do this, and I was only involved in about two of those hours."

"Be open to contributions; the LLM might help improve your taxonomy."

"I expect that this process is scalable across other systems."

"Good luck as you venture into this wild new world."

Sean Fitzell
Craft of User Research: Building Out Jobs to be Done Maps
2021 • Advancing Research 2021
Gold
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group (Rosenfeld Community)
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users (Videoconference)
2020 • Advancing Research Community
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Cassini Nazir
The Dangers of Empathy: Toward More Responsible Design Research
2023 • Advancing Research 2023
Gold
Smitha Papolu
Theme 3 Discussion
2019 • Enterprise Experience 2019
Gold
Irina Tikhonova
Small Wins, Big Impact: Leveraging and Elevating User Engagement
2021 • Civic Design 2021
Gold
Rebecca Topps
Planning and conducting remote usability studies for accessibility (Videoconference)
2020 • Advancing Research Community
Rachael Dietkus, LCSW
Leading through the long tail of trauma (Videoconference)
2022 • Enterprise Community
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Billy Carlson
Pro-level UI Tips for Beginners
2022 • DesignOps Summit 2022
Gold
Jamie Beck Alexander
How can you find your role in climate? (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Gretchen Anderson
Scaling the Human Center
2017 • Enterprise Experience 2017
Gold

More Videos