Summary
As culture and technology evolve, researchers must learn to co-exist with AI. Understanding its benefits, limitations, and ethical challenges is essential. This guide offers practical insights on top AI tools, advice on when and how to integrate AI into workflows, and a balanced view of the good, the bad and the ugly of the current AI landscape.
Key Insights
-
•
AI is shifting the authoritative voice in research from humans to generative models, challenging researchers’ traditional value.
-
•
Framing research value by sheer output risks commoditizing the field and losing long-term business impact.
-
•
Measuring research impact through concrete business outcomes is harder but essential for sustaining researcher relevance.
-
•
Research integrity is at risk if AI adoption isn't rigorously tested, as stakeholders expect researchers to model best practices.
-
•
AI tools can introduce biases especially affecting marginalized groups, impacting fairness in user research.
-
•
User researchers’ specialized skills in navigating complex trade-offs uniquely position them to integrate AI responsibly.
-
•
The lack of standardized methods for using AI in social science research makes learning from engineers and scientists critical.
-
•
Human data collection remains irreplaceable due to AI's weaknesses in understanding niche cultures and novel insights.
-
•
AI enables researchers to extend beyond study execution into prototyping, impact tracing, and direct product decision influence.
-
•
The rise of AI-powered 'triple threat' researchers combines research, product management, and design augmented by AI capabilities.
Notable Quotes
"Right now, there’s a fear of being replaced by AI, and while a lot of that’s overblown, researchers have a legitimate reason to feel uncomfortable."
"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."
"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."
"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."
"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."
"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."
"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."
"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."
"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."
"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."
Dig deeper—ask the Rosenbot:
More Videos
"Data is only as good as insights that come out of it and action."
Kristen Honey"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
November 18, 2021
"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."
Sam ProulxSUS: A System Unusable for Twenty Percent of the Population
December 9, 2021
"Design thinking has to be embedded at scale to capture and align creativity across a massive company."
Surya VankaUnleashing Swarm Creativity to Solve Enterprise Challenges
June 10, 2021
"These steps aren’t just research tactics – they could be life savers when employed well."
Amanda Kaleta-Kott Lea Martin, PhDThe Joys and Dilemmas of Conducting UX Research with Older Adults
March 11, 2022
"We didn’t have a clear definition of what Verizon customer experiences were or how they behaved, which led us to create experience principles."
Sarah WilliamsVerizon_A Framework for CX Transformation
January 8, 2024
"Obsession with gadgetry and cool tech ignores the fact that most critical future changes are mundane and essential, like clean water."
Devon PowersImagining Better Futures
March 9, 2022
"Our biggest hope is that you gain confidence to see opportunity and realize it amid crisis."
Lada GorlenkoTheme 2 Intro
June 9, 2022
"Our brain doesn’t know the difference between a tiger trying to eat us or an angry email from our manager."
Alla WeinbergHow to Build and Scale Team Safety
January 8, 2024
"Sponsor sessions are not sales pitches. They offer really high content very similar to the main conference."
Louis Rosenfeld Bria AlexanderOpening Remarks
March 27, 2023
