Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Thursday, August 31, 2023 • Advancing Research Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Speakers: Dr. Jamika D. Burge , Nick Fine , Alexandra Jayeun Lee , Greg Nudelman and Bo Wang
Link:

Summary

Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”. – Nick Fine “Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.” – Alexandra Jayeun Lee Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.” – Greg Nudelman “UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why." – Bo Wang

Key Insights

  • AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.

  • Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.

  • Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.

  • AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.

  • Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.

  • UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.

  • Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.

  • Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.

  • Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.

  • Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.

Notable Quotes

"AI has as much capacity to do as much harm as it does good."

"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."

"Learning prompt engineering will make us better researchers in the same way coding helped designers."

"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."

"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."

"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

"AI is biased by design; assume bias is in there, call it out, and then address it."

"User research's value lies in linking user needs and pain points directly to business profit and loss."

"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."

Ask the Rosenbot
Nathan Shedroff
Double Your Mileage: Use Your Research Strategically
2020 • Advancing Research 2020
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Civic Design 2022
Gold
Jon Fukuda
Storytelling for DesignOps
2023 • DesignOps Community
Josh Clark
Sentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
2025 • Rosenfeld Community
Michele Wong
Helping Them Help Us
2024 • Enterprise Experience 2020
Gold
Peter Van Dijck
Hands on AI #3: Claude Code for UX people
2025 • Rosenfeld Community
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Prabhas Pokharel
Order and Chaos: New Ways of Collaborating on Synthesis and Storytelling
2022 • Advancing Research 2022
Gold
Irina Tikhonova
Small Wins, Big Impact: Leveraging and Elevating User Engagement
2021 • Civic Design 2021
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Jorge Arango
Design as an Antidote to VUCA
2019 • Enterprise Community
Robert Schwartz
We're Here for the Humans
2017 • Enterprise Experience 2017
Gold
Billy Carlson
Principles of Team Wireframing
2023 • DesignOps Summit 2023
Gold
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold
Jorge Arango
The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)
2024 • Rosenfeld Community

More Videos

Renee Reid

"I was kind of wandering around aimlessly trying to find the next job."

Renee Reid

Becoming a ResearchH.E.R (Highly Enterprise Ready)

June 3, 2019

Cara Maritz

"Delivering a clear request along with your project’s goal helps get buy-in and clarifies what collaborators need to provide."

Cara Maritz Rachel Ny

The Art of Extrapolation

March 29, 2023

Bria Alexander

"There is no overlap between the main program sessions and sponsor sessions."

Bria Alexander

Opening Remarks

January 8, 2024

Sean Fitzell

"Mapping jobs gives a view into behaviors and needs that may or may not include your solution."

Sean Fitzell Sarah Han Kayla Farrell

Craft of User Research: Building Out Jobs to be Done Maps

March 12, 2021

Mike Davidson

"Research is there to save you time, not to take up time."

Mike Davidson

Fireside Chat

March 11, 2022

Erin Malone

"Desktop publishing was the most disruptive change in an industry in the history of the US until now."

Erin Malone

Understanding the past to prepare for the future

July 19, 2024

Catherine Dubut

"Physical prototyping is a tool to explore interaction modalities and physically connected environments beyond all things digital."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Laine Riley Prokay

"Junior roles represent only one percent of design ops roles, raising the question if we are missing opportunities to cultivate new talent."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Kavana Ramesh

"Tracking blockers and pain points is often more useful than just tracking time for tasks in inclusive research."

Kavana Ramesh

Meaningful inclusion: Practicing accessibility research with confidence

September 24, 2024