Summary
Join Savina Hawkins as she presents a focused exploration of large language models in User Experience Research (UXR). This talk zeroes in on practical, actionable strategies for leveraging these advanced AI tools to enhance UXR outcomes. Savina will discuss the dual nature of large language models, illuminating their potential to both revolutionize and challenge UXR practices. Attendees will learn to identify and mitigate risks while maximizing the benefits of these models in real-world scenarios. The session promises a clear, concise roadmap for UX researchers to effectively integrate large language models into their workflow, ensuring positive, impactful results.
Key Insights
-
•
Judd Anton predicts prompt engineering will be a foundational skill for researchers by 2025.
-
•
AI tools have enabled condensing thousands of user insights into manageable unique ideas within minutes.
-
•
Large language models learn language skills purely from statistical patterns, not human understanding.
-
•
GPT’s transformer architecture allows fast and contextually relevant text generation.
-
•
Prompt engineering is both a science of optimization and an art of design mirroring qualitative interview skills.
-
•
Prompt chaining can sequentially automate complex, multi-step analysis workflows.
-
•
AI-generated outputs are probabilistic and sometimes incorrect, requiring critical human oversight.
-
•
Multi-threaded prompt chaining workflows can achieve human-quality qualitative analysis at scale.
-
•
The rise of AI in knowledge work challenges existing power structures, workflows, and capitalism itself.
-
•
Researchers’ humanistic skills uniquely position them to co-design ethical AI systems and maintain meaning-making.
Notable Quotes
"The best researchers are multi-method and they have five tools, with prompt engineering as the fifth emerging one."
"In just 15 minutes, I extracted thousands of quotes and turned feedback into a strategic opportunity map in 30 minutes."
"GPT is like a master chef who’s traveled the world sampling cuisines before creating new dishes."
"Large language models don’t understand language like we do; they generate statistically likely text based on training data."
"Prompt engineering is the craft of using specific inputs to elicit precise AI outputs, similar to designing discussion guides."
"Chains of prompts become designed information processing workflows that can scale research tasks."
"These AI tools can do the entire qualitative analysis process at the click of a button."
"Magic eight ball thinking is the risk of blindly accepting AI answers without critical evaluation."
"Artificial intelligence can’t produce meaning the way humans do; it industrializes plausible content generation."
"Our challenge is to design how humans and technology share the world in peace while shaping new knowledge work."
Or choose a question:
More Videos
"Ivana will teach you how to scale fast and big from day one through product operations."
Lada GorlenkoTheme 1: Intro
January 8, 2024
"My screener automatically reads out all incoming messages into my headphones, so I hear my voice, the Zoom messages, the speaker notes, and the slides all at once."
Sam ProulxOnline Shopping: Designing an Accessible Experience
November 29, 2023
"The designers started to send notes of thank you to the ex members of the design ops team for making their life easier."
Benjamin RealShowing the Value of DesignOps by Not Having a DesignOps Team
October 21, 2020
"The messiness and ambiguity of cultural change is by design; discomfort is part of the natural process."
Steve ChaparroBringing Into Alignment Brand, Culture and Space
August 13, 2020
"Every job is a climate job. Wherever we are, the climate needs us to address it in our role."
Sara ConklinA UXer’s 12-Month Journey from Climate Concern to Climate Credibility
June 26, 2025
"Each conference theme acts like a mini conference exploring a deep aspect of designing at scale."
Uday GajendarTheme 1: Introduction
June 9, 2021
"We have to create human-centered organizations where people thrive by trust and recognition, grow with influence, and want to make a difference."
Christian BasonInnovating With People: Unleashing the Potential of Civic Design
December 8, 2021
"Trust emerges through sharing work, receiving feedback, and trusting those around you to help you grow."
Erika Kincaid Brenna Heaps Jessica TsukimuraConnecting the Dots: How to Foster Collaboration and Build a Strong Design Review Culture
June 8, 2022
"We are moving from direct work to mediated work, from wanting things perfect to good enough for now, and from complete to adaptive and growing systems."
Hugh DubberlyProblems with Problems: Reconsidering the Frame of Designing as Problem-Solving
June 19, 2019
