Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Thursday, August 31, 2023 • Advancing Research Community
Share the love for this talk
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Speakers: Dr. Jamika D. Burge , Nick Fine , Alexandra Jayeun Lee , Greg Nudelman and Bo Wang
Link:

Summary

Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”. – Nick Fine “Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.” – Alexandra Jayeun Lee Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.” – Greg Nudelman “UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why." – Bo Wang

Key Insights

  • AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.

  • Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.

  • Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.

  • AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.

  • Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.

  • UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.

  • Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.

  • Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.

  • Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.

  • Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.

Notable Quotes

"AI has as much capacity to do as much harm as it does good."

"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."

"Learning prompt engineering will make us better researchers in the same way coding helped designers."

"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."

"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."

"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

"AI is biased by design; assume bias is in there, call it out, and then address it."

"User research's value lies in linking user needs and pain points directly to business profit and loss."

"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."

Ask the Rosenbot
Yunyan Li
UX Best Practices
2021 • Design at Scale 2021
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Theresa Marwah
How Atlassian is Operationalizing Respect in Research
2020 • Advancing Research Community
Clara Kliman-Silver
UX Futures: The Role of Artificial Intelligence in Design
2023 • Enterprise UX 2023
Gold
Michael Land
Establishing Design Operations in Government
2021 • DesignOps Community
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Enterprise Community
Kristin Skinner
Theme 1 Intro
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Leah Buley
Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
2024 • Rosenfeld Community
Saskia Liebenberg
Start Small for Big Impact
2019 • DesignOps Community
Shanti Mathew
Civic Design at Scale: Introducing the Public Policy Layer Cake
2021 • Civic Design 2021
Gold
Marc Fonteijn
Increase your confidence, influence, and impact (through a Professional Community)
2024 • Advancing Service Design 2024
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Advancing Research 2022
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold

More Videos

Erika Kincaid

"Critique is an opportunity to build a culture of trust upon grounded reality while developing your craft. - Chris"

Erika Kincaid Brenna Heaps Jessica Tsukimura

Connecting the Dots: How to Foster Collaboration and Build a Strong Design Review Culture

June 8, 2022

Jeff Ephraim Bander

"You should always have your research questions first before deciding to use eye tracking."

Jeff Ephraim Bander Ariane Rahn Philipp Reiter

Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research

March 11, 2022

Louis Rosenfeld

"Sometimes it's more fulfilling to help organizations build their UX maturity rather than only joining mature ones."

Louis Rosenfeld

Coffee with Lou

January 11, 2024

Uday Gajendar

"Mass production is here to stay; how do we make it more humanistic?"

Uday Gajendar Adam Richardson

From AI to Zeitgeist: Theory as the design antidote to AI hype

March 27, 2025

Johanna Kollmann

"The most significant source of confusion is the difference between research questions and interview questions - Erica Hall."

Johanna Kollmann

Insights-Driven Product Strategy: Get your Research to Count

December 6, 2022

Michael Weir

"When people start saying a page looks busy or cluttered, it's a strong shorthand indicating cognitive overload."

Michael Weir

Mixed Methods and Behavioural Science

May 26, 2023

Amy Brana Stuart

"Flying out to meet users and then flying home to design somewhere else is not sustainable or effective."

Amy Brana Stuart

Rest in Peace Fly-in-fly-out Design

June 9, 2022

"Every one of us is probably the lubricant in a system—you only notice us when things go bad."

Panel Discussion: Communicating the Value of DesignOps

November 7, 2018

Gabrielle Verderber

"Encourage adoption by sharing documentation in relevant channels, referring team members to it, and including it in onboarding."

Gabrielle Verderber

Documentation Your Team Will Actually Use

October 3, 2023