Rosenverse
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Thursday, August 31, 2023 • Advancing Research Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Speakers: Nick Fine , Alexandra Jayeun Lee , Greg Nudelman and Bo Wang
Link:

Summary

Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”. – Nick Fine “Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.” – Alexandra Jayeun Lee Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.” – Greg Nudelman “UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why." – Bo Wang

Key Insights

  • AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.

  • Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.

  • Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.

  • AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.

  • Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.

  • UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.

  • Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.

  • Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.

  • Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.

  • Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.

Notable Quotes

"AI has as much capacity to do as much harm as it does good."

"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."

"Learning prompt engineering will make us better researchers in the same way coding helped designers."

"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."

"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."

"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

"AI is biased by design; assume bias is in there, call it out, and then address it."

"User research's value lies in linking user needs and pain points directly to business profit and loss."

"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."

Ask the Rosenbot
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Tina Weisser
When AI Agents Meet Reality. Service Design Lessons from a Pilot
2026 • Rosenfeld Community
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community
Alla Weinberg
Workers Are Sick of Change: The Cure is Psychological Safety
2023 • Enterprise UX 2023
Gold
Louis Rosenfeld
About the Rosenverse
2026 • Rosenfeld Community
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Meredith Black
Building Community and Common Trends to Look for in 2021
2020 • DesignOps Community
Jayne Engle
Civic Design for the Next Seven Generations—A Discussion on Sacred Civics
2022 • Civic Design Community
Bill Scott
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
2015 • Enterprise UX 2015
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Steve Portigal
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Jackie Velasquez-Ross
Talent Acquisition and Our Responsibility
2020 • DesignOps Community
Joe Elmendorf
Shitty Maps: A Trojan Horse for Sensemaking
2026 • Rosenfeld Community

More Videos

Greg Petroff

"The way we build software now is fundamentally different; it's just easier to write code using platforms and microservices."

Greg Petroff

Everything is About to Change: Software as Material

June 8, 2016

Michael Polivka

"I worked through a volunteer task force of 15 people across the company to drive radical design collaboration."

Michael Polivka

Scaling Design through Relationship Maps

November 7, 2017

Bryce Benton

"I’m not a Python developer, I’m getting a lot of assistance from ChatGPT to help me write that."

Bryce Benton

[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library

June 4, 2024

Dave Hoffer

"Everything is designed around us; recognize that and use it to your advantage."

Dave Hoffer Joanne Weaver

UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer

April 3, 2025

Jim Kalbach

"You don’t have to call it jobs to be done — you can white label it or integrate its logic into your existing maps."

Jim Kalbach

Jobs To Be Done

February 25, 2021

Bassel Deeb

"Leading indicators help you be on the front foot and act before a risk becomes a crisis."

Bassel Deeb Will Osborn

Do More With Less: Equip and Lead Design Orgs Through Adversity

October 2, 2023

Sean McKay

"When done well, convergence means research isn’t a department, it’s a shared system of knowledge or a collective understanding that aligns teams."

Sean McKay

Coexisting with non-researchers: Practical strategies for a democratized research future

March 11, 2025

Alissa Briggs

"It’s better to run lots of quick, cheap experiments to remove doubt than to wait for the perfect, statistically significant test."

Alissa Briggs

How to Coach Enterprise Experimentation

May 14, 2015

Amanda Kaleta-Kott

"These steps aren’t just research tactics – they could be life savers when employed well."

Amanda Kaleta-Kott Lea Martin, PhD

The Joys and Dilemmas of Conducting UX Research with Older Adults

March 11, 2022