Accessible only to conference ticket holders.
Log in Create account
For 90 days after a conference, only paid ticket holders can watch conference videos. After that, all Gold members have access.
If you have purchased recording access and cannot see the video, please contact support.
Conducting pre-research with AI agent personas: Pressure-testing concepts for expert workflows
This video is featured in the AI and UX skill growth playlist.
Summary
Designers in complex domains like finance, healthcare, or government are often asked to design for expert workflows they barely understand, while their subject-matter experts are too busy to join every iteration. This case study shows how niche AI “agent personas” became an always-available, domain-aware first pass on ideas—helping a UX professional in fintech to pressure-test concepts, understand upstream/downstream impacts, and arrive at better prototypes faster. In this work, AI serves explicitly as a pre-research layer, not a substitute for real users, formal research, or usability testing, ensuring that human insight remains at the center of the design process.
Key Insights
-
•
AI personas can help UX teams pre-emptively pressure test complex workflows before SME access.
-
•
Structuring AI personas with detailed role, goals, pain points, and boundaries ensures specific and relevant feedback.
-
•
Including a confidence summary in AI responses helps users distinguish between grounded facts and inferences, mitigating hallucinations.
-
•
AI critiques of wireframes expose operational friction and workflow gaps, not just surface usability issues.
-
•
Integrating AI with codebases improves understanding of data lineage, user entitlements, and ecosystem dependencies.
-
•
AI cannot guarantee policy compliance or capture all organization-specific exceptions.
-
•
Early AI involvement fosters confident preparation and sharper questions in SME reviews.
-
•
AI-driven expanded scope can cause scope creep, needing prioritization and feasibility discussions with technology teams.
-
•
AI responses are generally repeatable and consistent when grounded in stable persona definitions.
-
•
AI pre-research helps challenge operational workflows, uncovering inefficiencies that improve overall UX beyond UI enhancements.
Notable Quotes
"Can AI help us do better in pre-research for expert-heavy workflows before we actually get access to the subject matter experts?"
"The real problem is that the team is already making decisions in incomplete conditions."
"Generic advice is usually too broad for a complex workflow such as escalation or compliance."
"AI personas can be valuable as bounded pre-research tool helping us think earlier and reduce avoidable gaps."
"The confidence summary was added to remind us that the AI response is provisional and needs verification."
"When AI got it wrong, it did so in ways that matter operationally, skipping required compliance or assuming outdated workflows."
"The biggest improvement was confidence — walking into a room with senior stakeholders prepared to ask sharper questions."
"AI cannot replace user research, usability testing, or domain expert validation."
"AI helped me challenge operational workflows and ask why approvals happen multiple times across systems."
"Running the same prompt with a defined persona produces consistent and reliable AI responses."
Or choose a question:
More Videos
"We’re not looking to attack individuals, but to attack these systems."
Spencer L. A. StultzWhy Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives
October 4, 2023
"Design and product is more about making sure design is part of product than implying any subordination."
Louis Rosenfeld Christian CrumlishOpening Remarks
November 29, 2023
"Because this is virtual, we have a digital swag bag with goodies you can access via QR code or URL."
Bria AlexanderOpening Remarks
November 18, 2022
"Ops folks are the linchpin connecting leadership and designers, orchestrating all the instruments."
Briana Thomas Christina RodriguezWhen Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org
September 30, 2021
"Having a design system is not an end goal. It’s about what the design system enables us to do in our unique company context."
Nina JurcicThe Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
October 3, 2023
"Designers have a hard time interpreting econometrics-driven quantitative research without bridging approaches."
Joshua NobleCasual Inference
October 6, 2023
"We need to build reliance and connection across individuals to help balance power and build trust."
Robert FabricantShifting dynamics: The evolving relationship between researchers, participants, and organizational systems
March 11, 2025
"Start with baby steps, solve one pain point at a time and build from there."
Dolly ParikhExit Interview #7: Journey of a Social Entrepreneur
May 21, 2026
"I am so glad to be part of this new design ops community and wish you all the best of success."
Stephen PollardClosing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
November 7, 2017
