Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
Speakers: Llewyn Paine
Link:

Summary

As culture and technology evolve, researchers must learn to co-exist with AI. Understanding its benefits, limitations, and ethical challenges is essential. This guide offers practical insights on top AI tools, advice on when and how to integrate AI into workflows, and a balanced view of the good, the bad and the ugly of the current AI landscape.

Key Insights

  • AI is shifting the authoritative voice in research from humans to generative models, challenging researchers’ traditional value.

  • Framing research value by sheer output risks commoditizing the field and losing long-term business impact.

  • Measuring research impact through concrete business outcomes is harder but essential for sustaining researcher relevance.

  • Research integrity is at risk if AI adoption isn't rigorously tested, as stakeholders expect researchers to model best practices.

  • AI tools can introduce biases especially affecting marginalized groups, impacting fairness in user research.

  • User researchers’ specialized skills in navigating complex trade-offs uniquely position them to integrate AI responsibly.

  • The lack of standardized methods for using AI in social science research makes learning from engineers and scientists critical.

  • Human data collection remains irreplaceable due to AI's weaknesses in understanding niche cultures and novel insights.

  • AI enables researchers to extend beyond study execution into prototyping, impact tracing, and direct product decision influence.

  • The rise of AI-powered 'triple threat' researchers combines research, product management, and design augmented by AI capabilities.

Notable Quotes

"Right now, there’s a fear of being replaced by AI, and while a lot of that’s overblown, researchers have a legitimate reason to feel uncomfortable."

"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."

"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."

"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."

"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."

"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."

"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."

"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."

"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."

"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."

Ask the Rosenbot
Bram Wessel
Enterprise Information Architecture
2020 • Enterprise Community
Holly Cole
Understanding Experiences: When you have to do more than work
2018 • DesignOps Summit 2018
Gold
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Conference
Peter Merholz
The Mysterious Case of the Missing UX Career Path
2022 • DesignOps Community
Megan Clegg
Space for Everyone: Reframing Accessibility Through a Wider Lens
2021 • Design at Scale 2021
Gold
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
Billy Carlson
Pro-level UI Tips for Beginners
2022 • DesignOps Summit 2022
Gold
Jen Briselli
Learning Is The Engine: Designing & Adapting in a World We Can’t Predict
2025 • Rosenfeld Community
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
Saara Kamppari-Miller
"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do
2019 • DesignOps Summit 2019
Gold
Courtney Kaplan
Taking it to the next level: Career paths in DesignOps
2018 • DesignOps Summit 2018
Gold
Sharon Banh
Reimagining research: What does the field need to grow? [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Neil Barrie

"We are at an inflection point where what got us here won't necessarily get us to a thriving future."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

Lada Gorlenko

"Stakeholders start demanding better digital experiences at work because they expect the same quality they have at home."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Fredrik Matheson

"If you say great user experience, no, it’s not specific, it’s not measurable, it’s not actionable."

Fredrik Matheson

First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.

June 8, 2016

Liwei Dai

"The AI planning monkey and banana problem made me question whether getting the bananas is really the end goal."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Jon Fukuda

"Innovation has to fit within the tempo and rhythm of the organization and leadership."

Jon Fukuda Amy Evans Ignacio Martinez Joe Meersman

The Big Question about Innovation: A Panel Discussion

September 25, 2024

Michelle Bejian Lotia

"AI can help us cut through noise and speed up the so-what part of insights but can’t replace human knowledge of strategy and customers."

Michelle Bejian Lotia Anne-Marie Morell

Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization

March 28, 2023

Kristen Honey

"It’s easier to create a better system that makes your old system obsolete than to change what is baked in."

Kristen Honey

"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design

November 18, 2021

Lais de Almeida

"The lack of consistency between healthcare IT systems causes critical information delays and interrupted care."

Lais de Almeida Maria Izquierdo

Designing Data Services

December 4, 2024

John Cutler

"Executives only like things in threes, but if you do a three by three, you can get away with nine boxes—that's the max executive information processing."

John Cutler

The Alignment Trap

November 29, 2023