Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
This video is featured in the AI Trends in User Research playlist.
Summary
Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”. – Nick Fine “Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.” – Alexandra Jayeun Lee Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.” – Greg Nudelman “UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why." – Bo Wang
Key Insights
-
•
AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.
-
•
Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.
-
•
Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.
-
•
AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.
-
•
Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.
-
•
UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.
-
•
Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.
-
•
Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.
-
•
Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.
-
•
Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.
Notable Quotes
"AI has as much capacity to do as much harm as it does good."
"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."
"Learning prompt engineering will make us better researchers in the same way coding helped designers."
"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."
"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."
"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."
"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."
"AI is biased by design; assume bias is in there, call it out, and then address it."
"User research's value lies in linking user needs and pain points directly to business profit and loss."
"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."
Or choose a question:
More Videos
"We aligned engineering, product management, and design with the exact same goals so no one could succeed while another failed."
Julie BaherCulture Change—My Journey
May 14, 2015
"You can’t put the toothpaste back in the tube once biased AI harms your brand or users."
Jay BustamanteNavigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
October 2, 2023
"The best way to build trust and bond in teams is just breaking bread together and sharing meals."
Jennifer Bolduc Diane Gregorio Emily DayWhat's involved with getting people back to work?: A panel discussion
July 1, 2021
"Most people have a marketing or sales strategy, but many research leaders look puzzled when asked about their research strategy."
Chris Geison Cristen Torrey Eric MahlstedtWhat is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question
March 4, 2021
"Each organization's design ops team looks a little different, but the foundations are the same."
Jilanna WilsonDistributed DesignOps Management
February 26, 2019
"If you measure an infinite number of customers, every change would be statistically significant, but not every change would be meaningful."
Landon BarnesAre My Research Findings Actually Meaningful?
March 10, 2022
"Civic design lets us nuance the full range of citizens’ behavior, which often isn’t purely rational."
Christian BasonInnovating With People: Unleashing the Potential of Civic Design
December 8, 2021
"We were spending 90% of our resource responding to tactical queries or performance reporting — essentially marking everyone's homework."
Catherine BlizzardUsing Integrated Insight to Drive Growth
March 10, 2022
"We need to reject the notion that work is our only identity."
Tess DixonC'mon Get Happy
September 29, 2021
