Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
Gold
Tuesday, March 11, 2025 • Advancing Research 2025

This video is featured in the PDI 2026 playlist.

Share the love for this talk
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
Speakers: Llewyn Paine
Link:

Summary

As culture and technology evolve, researchers must learn to co-exist with AI. Understanding its benefits, limitations, and ethical challenges is essential. This guide offers practical insights on top AI tools, advice on when and how to integrate AI into workflows, and a balanced view of the good, the bad and the ugly of the current AI landscape.

Key Insights

  • AI is shifting the authoritative voice in research from humans to generative models, challenging researchers’ traditional value.

  • Framing research value by sheer output risks commoditizing the field and losing long-term business impact.

  • Measuring research impact through concrete business outcomes is harder but essential for sustaining researcher relevance.

  • Research integrity is at risk if AI adoption isn't rigorously tested, as stakeholders expect researchers to model best practices.

  • AI tools can introduce biases especially affecting marginalized groups, impacting fairness in user research.

  • User researchers’ specialized skills in navigating complex trade-offs uniquely position them to integrate AI responsibly.

  • The lack of standardized methods for using AI in social science research makes learning from engineers and scientists critical.

  • Human data collection remains irreplaceable due to AI's weaknesses in understanding niche cultures and novel insights.

  • AI enables researchers to extend beyond study execution into prototyping, impact tracing, and direct product decision influence.

  • The rise of AI-powered 'triple threat' researchers combines research, product management, and design augmented by AI capabilities.

Notable Quotes

"Right now, there’s a fear of being replaced by AI, and while a lot of that’s overblown, researchers have a legitimate reason to feel uncomfortable."

"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."

"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."

"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."

"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."

"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."

"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."

"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."

"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."

"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."

Ask the Rosenbot
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
Reginé Gilbert
Asking the Right Questions: Life, Hope and Moving Forward During the Pandemic
2022 • Design at Scale 2022
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
Anat Fintzi
Delivering at Scale: Making Traction with Resistant Partners
2022 • Design at Scale 2022
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Catherine Blizzard
Using Integrated Insight to Drive Growth
2022 • Advancing Research 2022
Gold
Jemma Ahmed
Research at an inflection point: Adapting to a new era of collaboration, equity, and innovation
2025 • Advancing Research 2025
Gold
Jose Coronado
From Zero to Hero
2022 • DesignOps Summit 2022
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Soma Ghosh
What emerging methods are advancing UX research [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold

More Videos

Ben Reason

"Designers act as mediators and neutral parties to get stuck projects unstuck through design diplomacy."

Ben Reason Aline Horta Majid Iqbal Fabiano Leoni

Making the system visible: The fastest path to better decisions

November 20, 2025

Sam Proulx

"Having an assistant when presenting can remove distractions and let you focus on delivering your message."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

March 10, 2022

Anna Nguyen

"We don’t just want to make customers satisfied, but provide an amazing experience and get those around us excited about what we’re doing."

Anna Nguyen Emily Brogan

Why Our Voice of the Customer is Better Than Yours

March 10, 2022

Abby Covert

"The dream of cross-functional agile collaboration is there, but it’s quite hard to realize that because teams don’t have enough time to build trust."

Abby Covert Tomer Sharon

Panel: Collaboration Tools

November 6, 2017

Phil Hesketh

"The web content accessibility guidelines emphasize thinking about different ways people interact with our content."

Phil Hesketh

Designing Accessible Research Workflows

September 29, 2021

Irina Tikhonova

"You never get all your usability testers to respond, you always need to recruit more than you think."

Irina Tikhonova Kari Dietrich

Small Wins, Big Impact: Leveraging and Elevating User Engagement

December 9, 2021

Tim Frick

"Becoming a B Corp really made us redesign everything about the business."

Tim Frick

The journey of building a sustainable design practice

April 23, 2025

Catherine Dubut

"We could impact the end-to-end customer service and customer experience through our most underutilized asset: our store employees."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Justin Entzminger

"In Guatemala City, we tropicalize design methods—doing things à la tortres—to fit our unique languages and cultures."

Justin Entzminger Terrance Smith Tracy M. Colunga Mai-Ling Garcia

Risk and Reward: How to Diversify the Field of Civic Innovators and Designers

November 17, 2022