Rosenverse
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Thursday, August 31, 2023 • Advancing Research Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Speakers: Nick Fine , Alexandra Jayeun Lee , Greg Nudelman and Bo Wang
Link:

Summary

Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”. – Nick Fine “Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.” – Alexandra Jayeun Lee Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.” – Greg Nudelman “UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why." – Bo Wang

Key Insights

  • AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.

  • Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.

  • Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.

  • AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.

  • Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.

  • UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.

  • Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.

  • Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.

  • Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.

  • Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.

Notable Quotes

"AI has as much capacity to do as much harm as it does good."

"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."

"Learning prompt engineering will make us better researchers in the same way coding helped designers."

"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."

"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."

"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

"AI is biased by design; assume bias is in there, call it out, and then address it."

"User research's value lies in linking user needs and pain points directly to business profit and loss."

"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."

Ask the Rosenbot
Anna Poznyakov
Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
2021 • Advancing Research 2021
Gold
Saara Kamppari-Miller
"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do
2019 • DesignOps Summit 2019
Gold
Alexandra Schmidt
Why Ethics Can't Save Tech
2022 • Civic Design 2022
Gold
Bria Alexander
Day 2 Welcome
2024 • DesignOps Summit 2024
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Kayla Farrell
What It's Like To Be a User Researcher at Compass
2021 • Advancing Research 2021
Gold
George Abraham
Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
2021 • DesignOps Summit 2021
Gold
Etienne Fang
Power of Insights: Why sharing is better than silos with Uber’s Insights Platform
2019 • Advancing Research Community
Roberta Dombrowski
Making Research a Team Sport
2022 • Advancing Research 2022
Gold
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold
Jemma Ahmed
Redefining the research toolkit: Expanding methodologies for a changing world
2025 • Advancing Research 2025
Gold
Shreya Dhawan
Making service tangible: the fastest path to higher performance
2025 • Advancing Service Design 2025
Gold
Darian Davis
Lessons from a Toxic Work Relationship
2024 • Enterprise Experience 2020
Gold
Peter Levin
Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
2024 • Advancing Research 2024
Gold
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization
2020 • Enterprise Community

More Videos

John Cutler

"The subtle art of taking care of yourself and giving a f in ways that generally encourage coherent behaviors."

John Cutler

The Alignment Trap

November 29, 2023

Jemma Ahmed

"Research teams need to be strategic about building tools to do ethical research, not just diverse."

Jemma Ahmed Robert Fabricant Sean McKay Llewyn Paine Kate Towsey Noah Bond

Theme Panel

March 11, 2025

Jon Fukuda

"You can be right without making others wrong by telling a story that respects their worldview."

Jon Fukuda

Storytelling for DesignOps

August 17, 2023

Kristin Skinner

"The future of education lies in collaboration and adaptation."

Kristin Skinner

Five Years of DesignOps

September 29, 2021

Christopher Taylor Edwards

"Developers were hungry for the bigger picture, but the only information available to them was a set of user stories."

Christopher Taylor Edwards Valerie Roske

Design as a Team Practice, A Practical Guide to Cross-functional Collaboration

September 30, 2021

Amy Paris

"People use gender and sex interchangeably, but as identities evolve, that creates complications for medical and benefit forms."

Amy Paris Danielle Thierry

Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities

December 9, 2021

Julie Gitlin

"Design isn’t here to save the day but to see things through to the next day."

Julie Gitlin Esther Raice

Design as an Agent of Digital Transformation at JPMC

June 9, 2021

Louis Rosenfeld

"Researchers have really taken it on the chin during this latest economic downturn."

Louis Rosenfeld Bria Alexander

Opening Remarks

March 27, 2023

Davis Neable

"The complex problem we were solving was not really solution based at all. It was a cultural team alignment problem."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021