Why AI Is Bad at Research (and how to make it actually useful)
Summary
LLMs are everywhere, but when it comes to real research, they often fall short. Generic LLMs weren’t built for continuous research workflows, and product researchers quickly see the problem: the outputs are generic, lack full context, and struggle to connect multiple data sources. Instead of surfacing meaningful insights, they can amplify noise. In this session, Daniel will break down why AI often fails research teams and what’s missing. He’ll show how to make AI actually useful for continuous product research. Accelerating analysis, connecting insights across sources, and keeping researchers at the center, equipped with a powerful tool rather than replaced by one.
Key Insights
-
•
AI in research struggles with large datasets, often averaging results and missing subtle but important signals.
-
•
Curating and filtering datasets by removing irrelevant data improves AI research output quality.
-
•
Scoping research into focused projects or topics helps AI deliver more precise responses.
-
•
Asking one question at a time significantly enhances the quality of AI-generated answers.
-
•
Providing detailed contextual information (personas, company background, product details) to AI boosts specificity and nuance in responses.
-
•
AI hallucinations and trust issues necessitate human-in-the-loop processes to verify output quality and citations.
-
•
Iterative refinement of AI outputs, similar to app development, is critical for achieving polished research results.
-
•
Spot checking AI-generated citations can be an effective and efficient way to validate research quality.
-
•
Context passed as embedded knowledge rather than repeated in prompts yields better AI results.
-
•
Using multiple specialized AI agents to critique each other’s outputs can mitigate bias and improve research accuracy.
Notable Quotes
"AI has this strange weakness that when working with a large dataset, they often miss crucial, subtle findings."
"The larger the dataset you work with, the more costly it is to run a single operation on AI models."
"Whenever possible, you should be breaking down your work into specific research projects or topics."
"When you ask a question, try to ask one at a time so the model doesn't get lost."
"Context is everything — providing AI with a folder of your company’s knowledge makes responses more detailed and useful."
"Research with AI requires as much iteration and verification as building an app or prototype."
"AI-generated research reports should always be tied to real feedback that you can verify behind every sentence."
"There's no way to deny it: every industry needs to adapt to AI, but nobody really knows how yet."
"Human in the loop means constantly interacting with AI, documenting your thoughts and assuring quality."
"Some engineers build a council of agents that debate and generate responses, which can help with bias and accuracy."
Or choose a question:
More Videos
"Most B2B research is done remotely and online, so we needed a tool that was easy to use without in-person facilitation."
Sean DolanA Practical Look at Creating More Usable Enterprise Customer Journeys
October 31, 2019
"UX research is a journey, not just a switch you flick on; many challenges you face have been experienced by others in the community."
Caroline VizeThe State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022
March 9, 2022
"Everything is designed around us; recognize that and use it to your advantage."
Dave Hoffer Joanne WeaverUX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
April 3, 2025
"We must recognize multi-track career and multi-level skill sets, avoiding the single-track start-over model."
Mackenzie GuinonM.C. Escher’s UX Research Career Ladder
March 9, 2022
"Please do not engage in mining; research is not a mining operation."
Sahibzada MayedThe Politics of Radical Research: A Manifesto
March 27, 2023
"Collaborative workflow with permissions, task assignments, and multiple stakeholders is the next big design challenge."
Greg PetroffDesign is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
June 9, 2021
"In that moment, I looked down at my chest and failed to find a breast pocket of my own."
Mansi GuptaDrawing from Feminist Practice to Make Inclusive Design Operational
September 9, 2022
"My goal for today is to showcase how generative AI can go beyond just speeding up our processes to actually catapult us in our career."
Fisayo Osilaja[Demo] The AI edge: From researcher to strategist
June 4, 2024
"Research skill and talent can be present in many different kinds of people, you don’t have to have research in your title."
Megan BlockerA Selectively Scrappy Approach to ResearchOps
November 8, 2018
