Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
AI-Assisted Qualitative Analysis: What to Automate and What to Own
This video is featured in the UX Watch Party playlist.
Summary
Key Insights
-
•
Qualitative analysis involves moving beyond patterns to generating meaningful explanations and insights.
-
•
AI works best when humans fully understand the research process and guide AI step-by-step.
-
•
Structured data can be heavily automated by AI, reducing manual coding efforts.
-
•
Messy, rich qualitative data requires strong human oversight and involvement to capture unexpected insights.
-
•
Humans bring subjective intuition and surprise to analysis, which AI currently cannot replicate.
-
•
Keeping humans in the loop means supervising major decisions, reviewing AI outputs, and continually refining codes.
-
•
The thematic analysis process benefits from breaking work into discrete steps for AI to perform under human supervision.
-
•
Cognitive offloading risks dulling critical qualitative research skills if AI is overused.
-
•
Adversarial AI agents can be employed to challenge and verify AI-generated findings before human review.
-
•
AI tools can assist in report writing by handling repetitive tasks like tallying but struggle to replicate human narrative tone and excitement.
Notable Quotes
"If you don't understand the process, you're not going to get very far with using AI for analysis."
"AI is a tool. It can be as powerful as the person who is wielding that tool."
"Qualitative analysis isn’t just to call out patterns but to explain why they’re there and make them meaningful for your audience."
"Automate the hell out of structured data, but stay involved in messy, rich data."
"Think of AI as an extra colleague: it does the first pass, you do the second pass."
"Coding is more important than the output; it forces you to be familiar with and think deeply about your data."
"Use AI to remove boring, menial tasks but preserve the manual, difficult hard work for yourself."
"Slowing down on messy data is worth it because you could miss something incredibly important that changes the trajectory of the product."
"Adversarial verification with a second AI agent trying to poke holes in findings mimics how human researchers challenge each other."
"AI doesn’t feel surprise or curiosity, but humans do, and that’s a unique strength in analysis."
Or choose a question:
More Videos
"Design ops has the opportunity to set a new default future, not follow the path set by the past."
Dr. Karl JeffriesThe Science of Creativity for DesignOps
January 8, 2024
"The culture between buyer and user impacts feature adoption and overall satisfaction."
Amy MarquezINVEST: Discussion
June 15, 2018
"Pilot projects with evangelists inside the company make ethnography manageable and successful."
Steve Portigal Chris Chapo Kelly Goto Christian RohrerDiscussion
May 13, 2015
"Dedicated staffing gives designers deep vertical mastery but limits horizontal experience."
Alicia MootyDesign Staffing Models
September 30, 2021
"I am not throwing away your UX."
Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt LaurenceThe Authentic UX Talent Show
January 8, 2024
"Simply asking stakeholders what success looks like for them in a project is a powerful way to start meaningful conversations."
Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne RogondinoTheme 1: Discussion
January 8, 2024
"It’s very difficult to align researcher goals with business growth, but that’s exactly what we try to do."
Sofia QuinteroThe Product Philosophy Behind EnjoyHQ
March 10, 2021
"The incentive structure at a big company is set up to reward people for entirely different stuff than innovation requires."
Laura KleinUnique challenges of innovation in enterprises
April 23, 2020
"Embedded squads build domain expertise but risk losing knowledge if someone leaves, while centralized teams help reduce duplicated effort."
Andrew MichaelBuilding a Product Insights Team
March 10, 2022
