Accessible only to conference ticket holders.
Log in Create account
For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.
If you have purchased recording access and cannot see the video, please contact support.
Conducting pre-research with AI agent personas: Pressure-testing concepts for expert workflows
This video is featured in the AI and UX skill growth playlist.
Summary
Designers in complex domains like finance, healthcare, or government are often asked to design for expert workflows they barely understand, while their subject-matter experts are too busy to join every iteration. This case study shows how niche AI “agent personas” became an always-available, domain-aware first pass on ideas—helping a UX professional in fintech to pressure-test concepts, understand upstream/downstream impacts, and arrive at better prototypes faster. In this work, AI serves explicitly as a pre-research layer, not a substitute for real users, formal research, or usability testing, ensuring that human insight remains at the center of the design process.
Key Insights
-
•
AI personas can help UX teams pre-emptively pressure test complex workflows before SME access.
-
•
Structuring AI personas with detailed role, goals, pain points, and boundaries ensures specific and relevant feedback.
-
•
Including a confidence summary in AI responses helps users distinguish between grounded facts and inferences, mitigating hallucinations.
-
•
AI critiques of wireframes expose operational friction and workflow gaps, not just surface usability issues.
-
•
Integrating AI with codebases improves understanding of data lineage, user entitlements, and ecosystem dependencies.
-
•
AI cannot guarantee policy compliance or capture all organization-specific exceptions.
-
•
Early AI involvement fosters confident preparation and sharper questions in SME reviews.
-
•
AI-driven expanded scope can cause scope creep, needing prioritization and feasibility discussions with technology teams.
-
•
AI responses are generally repeatable and consistent when grounded in stable persona definitions.
-
•
AI pre-research helps challenge operational workflows, uncovering inefficiencies that improve overall UX beyond UI enhancements.
Notable Quotes
"Can AI help us do better in pre-research for expert-heavy workflows before we actually get access to the subject matter experts?"
"The real problem is that the team is already making decisions in incomplete conditions."
"Generic advice is usually too broad for a complex workflow such as escalation or compliance."
"AI personas can be valuable as bounded pre-research tool helping us think earlier and reduce avoidable gaps."
"The confidence summary was added to remind us that the AI response is provisional and needs verification."
"When AI got it wrong, it did so in ways that matter operationally, skipping required compliance or assuming outdated workflows."
"The biggest improvement was confidence — walking into a room with senior stakeholders prepared to ask sharper questions."
"AI cannot replace user research, usability testing, or domain expert validation."
"AI helped me challenge operational workflows and ask why approvals happen multiple times across systems."
"Running the same prompt with a defined persona produces consistent and reliable AI responses."
Or choose a question:
More Videos
"One theme was very clear and that was around the future."
Alana WashingtonTheme 3 Intro
October 1, 2021
"The Ministry of Culture will be the only government office totally open for public use."
Sofía Delsordo Kassim VeraPublic Policy for Jalisco's Designers to Make Design Matter
December 8, 2021
"When your whole operating model changes, you have to step back, breathe, restart, and rely on the best practices you’ve learned."
Crystal PhilcoxThe Many Faces of Operations
November 6, 2017
"Focus changes are critical to inform screen reader users when dialogs open or content changes."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"Choosing a research repository is a big battle in your organization; the right decisions can really help you succeed."
Sofia QuinteroThe Product Philosophy Behind EnjoyHQ
March 10, 2021
"In order to lead change, you turn change itself into the product."
Doug PowellDesignOps and the Next Frontier: Leading Through Unpredictable Change
September 11, 2025
"A simple quadrant diagram helped our product manager tell the story to leadership and made him look good."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"Bias is fueled by over-engineering without enough participation from non-technical roles that could reduce it."
Joel BranchHumanizing AI: Filling the Gaps with Multi-faceted Research
March 11, 2021
"Building on AI and generative AI means giving up control."
Katie JohnsonDisrupting generative AI products with just-in-time consumer insights
June 4, 2024
