Research Repositories
This video is featured in the UX metrics & analytics playlist.
Summary
Key Insights
-
•
Research repositories vary widely, from libraries of reports to rich knowledge bases integrating multiple data sources.
-
•
One major challenge is motivating researchers and non-researchers to consistently populate repositories with relevant, contextualized data.
-
•
Adding contextual metadata—like methodology, market, and date—is crucial for meaningful repository content.
-
•
The term ‘research repository’ is evolving into ‘customer knowledge base’ reflecting integration across organizational knowledge.
-
•
Using templates to structure research entries simplifies data input and improves AI’s ability to parse and summarize content.
-
•
AI agents can help maintain context when searching repositories and flag when no relevant answers exist, reducing hallucinations.
-
•
Human oversight remains essential to verify the relevance and accuracy of AI-generated search results, especially with dated data.
-
•
Integrating AI bots with communication tools like Slack increases repository adoption by enabling on-demand access to research insights.
-
•
Context retention by AI is necessary to prevent misleading conclusions, such as mixing up different customer segments or outdated information.
-
•
Scoring research impact and linking recommendations to outcomes in repositories can improve organizational learning but is still emerging.
Notable Quotes
"Personally, if I was gonna go into some aspect of UX research, I would jump in with both feet into research repositories."
"There are so many different variations of repositories, from research libraries to databases cataloging atomic insights."
"Research knowledge by itself is not enough. You need to add other sources like user voice, surveys, and customer feedback."
"You cannot just put this 5% of users did not want this without knowing why or where this insight came from."
"AI agents should understand the entire context and, if no suitable result exists, come back honestly without lying."
"We made it mandatory to have a one-pager summary for every research project to make insights easy to manage."
"To motivate people to populate the repository, be annoyingly persistent and sometimes create the template for them."
"Connecting the repository to Slack and building an AI bot to answer questions fascinates users and drives usage."
"We have been good with not having fake or hallucinated answers so far, and retaining context is key."
"Human oversight is crucial because no single metric like date alone can determine if research is outdated or still relevant."
Or choose a question:
More Videos
"Researchers are trained to see power and power imbalances, but seeing our own agency is uncomfortable because it infers responsibility."
Brigette MetzlerScaling ResearchOps: Helping Researchers do Their Best Work
March 30, 2020
"Even though we’ve got a single dropdown field, it maps to a far richer set of instructions in the prompt."
Trisha Causley[Demo] Complexity in disguise: Crafting experiences for generative AI features
June 5, 2024
"Leadership doesn’t only mean managing; it can be mentoring, product leadership, or technical influence."
Ian SwinsonDesigning and Driving UX Careers
June 8, 2016
"AI itself has a very large carbon footprint, so we have to balance adoption with our environmental goals."
Louis Rosenfeld Billy Carlson Jon Fukuda Maria TaylorHow AI will Change DesignOps Tooling
October 3, 2023
"Nobody reads extensive research reports; VPs just want to know what it means for their risk and decisions."
Leah Buley Joe NatoliAsk Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
October 8, 2024
"Intersectionality is a lens to understand how dominant culture creates obstacles outside of conventional advocacy."
Spencer L. A. StultzWhy Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives
October 4, 2023
"Data scientists are part stats geek, part hacker, and part entrepreneur."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"We are living in a world that for so many feels like it has been flipped on its head."
Jemma AhmedTheme 2 Intro
March 10, 2022
"Our mission is to support the methods and processes devoted to producing high quality design."
Jilanna WilsonDistributed DesignOps Management
February 26, 2019