Summary
Large Language Models (LLMs) are to language as spreadsheets are to numbers: tools for modeling, exploration, and development. Among their many capabilities, LLMs can alleviate chores related to the design and implementation of information architectures. But doing so requires venturing beyond chat-based interfaces. In this brief demonstration, we'll see how to use OpenAI's API and a few open source command line tools to re-categorize content in a 1,000+ page website. The techniques demonstrated can be extended to other common content organization tasks.
Key Insights
-
•
The discoverability of older content on blogs is often a challenge, making accurate tagging essential.
-
•
LLMs like GPT-4 can significantly reduce the manual workload involved in organizing content.
-
•
A structured approach to task automation can be effectively implemented using a four-step framework.
-
•
Having a clean, obvious taxonomy is crucial for successful AI interaction and content tagging.
-
•
Reviewing AI-generated changes before implementation is necessary to ensure accuracy and relevance.
-
•
AI can provide valuable insights, potentially improving existing classification systems.
-
•
LLMs can function as both a tagging assistant and a surveyor of content relevance.
-
•
Automation can save considerable time and effort, exemplifying the potential of AI in daily tasks.
-
•
This process can be scaled to various content management systems beyond static site generators.
-
•
Engaging with the community for feedback can enhance AI implementation experiences.
Notable Quotes
"I'm an information architect, which means that I organize websites and apps to make stuff easier to find and understand."
"This is a case study on one such toil that I've been removing using LLMs."
"The more recent stuff gets more attention and the older stuff has discoverability problems."
"The first step is gathering the information and the second step is reviewing the changes that the LLM is proposing to make."
"I had to clean this taxonomy up, and I eliminated terms like TAOI."
"GPT actually functioned as an assistant, not just in retagging things, but also in the taxonomy itself."
"It took about three hours from beginning to end to do this, and I was only involved in about two of those hours."
"Be open to contributions; the LLM might help improve your taxonomy."
"I expect that this process is scalable across other systems."
"Good luck as you venture into this wild new world."
More Videos
"Be prepared for change; change is imminent."
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018
"Each time we communicate, we share in the basic need for human connection."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"Your insights need to be framed in a way that talks to overall goals you're trying to achieve."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"If you feel like there's a lag, we want to know about it."
Bria AlexanderDay 3 Welcome
September 25, 2024
"When you explore lots of different ideas, you're going to understand the context better."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022
"When expectations are low for process, it’s the perfect opportunity to rifle through new approaches."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021
"The values we uphold guide how we experience and influence team dynamics."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"What's the last bad experience you had with another discipline?"
Adrian HowardSturgeon’s Biases
September 25, 2024
"Our work can't be evaluated in the same way that engineering work can."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023
