The Heart and Brain of the AI Research
Summary
Key Insights
-
•
UX research often stays on the surface of usability, missing deeper impacts related to data and AI models beneath the iceberg.
-
•
Natural language processing models require extensive and specific training data to understand diverse user utterances.
-
•
AI systems struggle to identify causality, often confusing correlation with cause and effect in user queries.
-
•
Users often engage in investigative dialogue before reaching their true question or desired outcome.
-
•
Human researchers can pinpoint why users interact with AI in unexpected ways by analyzing behavior beyond simple metrics like button clicks.
-
•
Collaboration between human researchers and AI scientists through shared observations and joint sense-making enhances AI development.
-
•
AI planning, such as the monkey and banana problem, offers a framework connecting user goals with efficient AI action sequences.
-
•
Human-centered research can inform training data selection, helping AI models to better predict and respond to user needs.
-
•
Effective AI product research requires understanding the technology enough to communicate meaningfully with technical teams.
-
•
Human researchers increase impact by shifting from passive observers to active participants in ideation, design, and strategy discussions.
Notable Quotes
"After more than 10 years of doing UX research, I was still only working above the iceberg, focusing on the usability and feature level."
"Machines can identify correlation via association, but it’s extremely difficult for them to reason and identify causality."
"People don’t always get straight to their question; they might need to do some investigation first before they figure out what to ask."
"The AI planning monkey and banana problem made me question whether getting the bananas is really the end goal."
"By identifying the triggers that lead customers to ask questions, I helped data scientists figure out what training data to explore."
"It’s not enough just sharing customer stories and insights; we need to get into the weeds and collaborate with product and tech partners."
"We need to be genuinely curious not just about our customers, but also about our colleagues and the technology behind AI."
"Our foundational interview, observation, and sense-making skills are evergreen and indispensable in the AI world."
"To be truly impactful, human researchers need to actively participate in product design sprints and strategy meetings."
"This emerging AI technology has given us a golden opportunity to combine the heart and brain of technology and make meaningful impact."
Or choose a question:
More Videos
"We all want to design for scale, but empathy alone is sometimes a shortcoming when thinking about scale."
Nancy DouyonWe'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
June 15, 2018
"UXPin is a full-stack platform that bridges the gap between design and development disciplines."
Jack BeharHow to Build Prototypes that Behave like an End-Product
December 6, 2022
"Vision types help us envision ideal futures freed from near-term constraints but must avoid magical thinking."
Jorge ArangoMeeting of the Waters: Designing for Successful Inorganic Growth
August 12, 2021
"What good are the insights if we can’t get them where they need to go, when they need to go there, and make sure they get used?"
Jon White Erin MayUnsticking Research for Better Information Flow
March 11, 2026
"Give a why of why you’ve made this design decision. It helps your team understand and reduces defensiveness."
Jessamyn EdwardsSurviving Your UX Career in Enterprise Design
December 2, 2021
"Build better foundations, not better facades."
Stefanie OwensOptimizing for Outcomes: Transformation Design in Systems at Scale
December 4, 2024
"It’s less about interaction and more about integrity: How can we build trust in experiences?"
Ron BronsonDesign, Consequences & Everyday Life
November 18, 2022
"Peter van D**e really pushed us to think about the bot as part of a conversation, not just a query-response machine."
Louis RosenfeldThe Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
June 5, 2024
"Collaboration is not just beneficial, it's essential for effective climate action."
Ash BrownSilver Linings: What DesignOps Learned in the Shift to WFH
October 23, 2020
