Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Thursday, August 31, 2023 • Advancing Research Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Speakers: Dr. Jamika D. Burge , Nick Fine , Alexandra Jayeun Lee , Greg Nudelman and Bo Wang
Link:

Summary

Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”. – Nick Fine “Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.” – Alexandra Jayeun Lee Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.” – Greg Nudelman “UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why." – Bo Wang

Key Insights

  • AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.

  • Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.

  • Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.

  • AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.

  • Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.

  • UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.

  • Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.

  • Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.

  • Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.

  • Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.

Notable Quotes

"AI has as much capacity to do as much harm as it does good."

"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."

"Learning prompt engineering will make us better researchers in the same way coding helped designers."

"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."

"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."

"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

"AI is biased by design; assume bias is in there, call it out, and then address it."

"User research's value lies in linking user needs and pain points directly to business profit and loss."

"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."

Ask the Rosenbot
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • Designing with AI 2025
Gold
Nidhi Singh Rathore
Embracing participation to unlock deeper truths in commercial research
2025 • Advancing Research 2025
Gold
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Gretchen Anderson
Scaling the Human Center
2017 • Enterprise Experience 2017
Gold
Bria Alexander
Day 3 Welcome
2024 • DesignOps Summit 2024
Gold
Caroline Jarrett
Garbage in, garbage out? Measuring error rates to get ready for AI
2026 • Rosenfeld Community
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Joshua Graves
We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)
2025 • Rosenfeld Community
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Jacqui Frey
Flow and Superfluidity for Design Orgs
2018 • DesignOps Summit 2018
Gold
Libby Maurer
Treating Diversity & Inclusion in Hiring as a Design Problem
2019 • Enterprise Community
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community
Josina Vink
Navigating the pitfalls of systems thinking in service design
2024 • Advancing Service Design 2024
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Alëna Iouguina
Designing Systems at Scale
2018 • DesignOps Summit 2018
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold

More Videos

Julie Baher

"We aligned engineering, product management, and design with the exact same goals so no one could succeed while another failed."

Julie Baher

Culture Change—My Journey

May 14, 2015

Jay Bustamante

"You can’t put the toothpaste back in the tube once biased AI harms your brand or users."

Jay Bustamante

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation

October 2, 2023

Jennifer Bolduc

"The best way to build trust and bond in teams is just breaking bread together and sharing meals."

Jennifer Bolduc Diane Gregorio Emily Day

What's involved with getting people back to work?: A panel discussion

July 1, 2021

Chris Geison

"Most people have a marketing or sales strategy, but many research leaders look puzzled when asked about their research strategy."

Chris Geison Cristen Torrey Eric Mahlstedt

What is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question

March 4, 2021

Jilanna Wilson

"Each organization's design ops team looks a little different, but the foundations are the same."

Jilanna Wilson

Distributed DesignOps Management

February 26, 2019

Landon Barnes

"If you measure an infinite number of customers, every change would be statistically significant, but not every change would be meaningful."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Christian Bason

"Civic design lets us nuance the full range of citizens’ behavior, which often isn’t purely rational."

Christian Bason

Innovating With People: Unleashing the Potential of Civic Design

December 8, 2021

Catherine Blizzard

"We were spending 90% of our resource responding to tactical queries or performance reporting — essentially marking everyone's homework."

Catherine Blizzard

Using Integrated Insight to Drive Growth

March 10, 2022

Tess Dixon

"We need to reject the notion that work is our only identity."

Tess Dixon

C'mon Get Happy

September 29, 2021