Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Harnessing AI in UXR: Practical Strategies for Positive Impact

Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Harnessing AI in UXR: Practical Strategies for Positive Impact
Speakers: Savina Hawkins
Link:

Summary

Join Savina Hawkins as she presents a focused exploration of large language models in User Experience Research (UXR). This talk zeroes in on practical, actionable strategies for leveraging these advanced AI tools to enhance UXR outcomes. Savina will discuss the dual nature of large language models, illuminating their potential to both revolutionize and challenge UXR practices. Attendees will learn to identify and mitigate risks while maximizing the benefits of these models in real-world scenarios. The session promises a clear, concise roadmap for UX researchers to effectively integrate large language models into their workflow, ensuring positive, impactful results.

Key Insights

  • Judd Anton predicts prompt engineering will be a foundational skill for researchers by 2025.

  • AI tools have enabled condensing thousands of user insights into manageable unique ideas within minutes.

  • Large language models learn language skills purely from statistical patterns, not human understanding.

  • GPT’s transformer architecture allows fast and contextually relevant text generation.

  • Prompt engineering is both a science of optimization and an art of design mirroring qualitative interview skills.

  • Prompt chaining can sequentially automate complex, multi-step analysis workflows.

  • AI-generated outputs are probabilistic and sometimes incorrect, requiring critical human oversight.

  • Multi-threaded prompt chaining workflows can achieve human-quality qualitative analysis at scale.

  • The rise of AI in knowledge work challenges existing power structures, workflows, and capitalism itself.

  • Researchers’ humanistic skills uniquely position them to co-design ethical AI systems and maintain meaning-making.

Notable Quotes

"The best researchers are multi-method and they have five tools, with prompt engineering as the fifth emerging one."

"In just 15 minutes, I extracted thousands of quotes and turned feedback into a strategic opportunity map in 30 minutes."

"GPT is like a master chef who’s traveled the world sampling cuisines before creating new dishes."

"Large language models don’t understand language like we do; they generate statistically likely text based on training data."

"Prompt engineering is the craft of using specific inputs to elicit precise AI outputs, similar to designing discussion guides."

"Chains of prompts become designed information processing workflows that can scale research tasks."

"These AI tools can do the entire qualitative analysis process at the click of a button."

"Magic eight ball thinking is the risk of blindly accepting AI answers without critical evaluation."

"Artificial intelligence can’t produce meaning the way humans do; it industrializes plausible content generation."

"Our challenge is to design how humans and technology share the world in peace while shaping new knowledge work."

Ask the Rosenbot
Changying (Z) Zheng
From prototype to production: Vibe coding design for real engineering systems
2026 • Designing with AI 2026
Conference
James Lang
If you can design an app, you can design a community
2025 • Rosenfeld Community
Vitorio Miliano
Don’t call it AI: Turn words into numbers with quantitative ethnography
2026 • Advancing Research 2026
Gold
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Gold
Changying (Z) Zheng
Practical DesignOps: From Ideas to Tools That Teams Actually Use
2025 • Rosenfeld Community
Erin Weigel
Failure Friday #6: 90% of Everything I Do is Either Broken or Pointless
2025 • Rosenfeld Community
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Kara Kane
Theme One Intro
2022 • Civic Design 2022
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Kathleen Asjes
Research Democratization: the Good, the Bad and the Ugly
2022 • Advancing Research 2022
Gold
Rachel Posman
A Closer Look at Team Ops and Product Ops (Two Sides of the DesignOps Coin)
2020 • DesignOps Community
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire
2022 • Civic Design Community
Alan Williams
Designing essential financial services for those in need
2022 • Civic Design Community
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • DesignOps Summit 2025
Gold
Scott Plewes
Why Isn't Your UX Approach Going Viral?: A Mathematical Model
2023 • Advancing Research 2023
Gold

More Videos

Feyikemi Akinwolemiwa

"In a world of AI where things are speeding up, it's more important than ever to position ourselves as teams that can actually change things."

Feyikemi Akinwolemiwa

Play to innovate: How curiosity and experimentation transform UX

March 11, 2026

Melissa Eggleston

"Listening with all your senses, not just the words they’re saying, reveals people’s true needs."

Melissa Eggleston Maya Israni Florence Kasule Owen Seely Andrea Schneider

Practical People Skills for Building Trust on Teams and with Partners

December 9, 2021

Jane Reid

"It’s okay to be honest with participants that you’re not the right person to help them and to signpost support respectfully."

Jane Reid Janice Hannaway

Self-care in User Research

April 2, 2020

Brian T. O’Neill

"Decision culture is a better lens than data culture for thinking about what decisions we're trying to facilitate with AI."

Brian T. O’Neill Maria Cipollone Luis Colin Manuel Dahm Mike Oren

Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?

February 18, 2022

Yoel Sumitro

"Researchers were obsessed with scientific rigor while designers used balance, feelings, or intuition as their rigor."

Yoel Sumitro

Actions and Reflections: Bridging the Skills Gap among Researchers

March 9, 2022

Natalia Radywyl

"The system had catastrophically failed to live up to expert expectations and was underprepared for future challenges."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Kristin Wisnewski

"Fletcher Prevend took us to the next level by reporting design and user research directly into the CIO office—a huge differentiator."

Kristin Wisnewski

Measuring What Matters

October 23, 2019

Lija Hogan

"Understanding how assistive technology evolves is crucial because it foretells the future of interface design."

Lija Hogan Milan Mijatovic Sam Proulx Louis Rosenfeld

Three Years Out: Perspectives on the Near-Term Future of User Research

March 15, 2024

Amahra Spence

"Our future is made up of today’s decisions, relationships, practices, and commitments—what do we need to practice now?"

Amahra Spence

Designing for Liberation, Rehearsing Freedom

November 18, 2022