Summary
As culture and technology evolve, researchers must learn to co-exist with AI. Understanding its benefits, limitations, and ethical challenges is essential. This guide offers practical insights on top AI tools, advice on when and how to integrate AI into workflows, and a balanced view of the good, the bad and the ugly of the current AI landscape.
Key Insights
-
•
AI is shifting the authoritative voice in research from humans to generative models, challenging researchers’ traditional value.
-
•
Framing research value by sheer output risks commoditizing the field and losing long-term business impact.
-
•
Measuring research impact through concrete business outcomes is harder but essential for sustaining researcher relevance.
-
•
Research integrity is at risk if AI adoption isn't rigorously tested, as stakeholders expect researchers to model best practices.
-
•
AI tools can introduce biases especially affecting marginalized groups, impacting fairness in user research.
-
•
User researchers’ specialized skills in navigating complex trade-offs uniquely position them to integrate AI responsibly.
-
•
The lack of standardized methods for using AI in social science research makes learning from engineers and scientists critical.
-
•
Human data collection remains irreplaceable due to AI's weaknesses in understanding niche cultures and novel insights.
-
•
AI enables researchers to extend beyond study execution into prototyping, impact tracing, and direct product decision influence.
-
•
The rise of AI-powered 'triple threat' researchers combines research, product management, and design augmented by AI capabilities.
Notable Quotes
"Right now, there’s a fear of being replaced by AI, and while a lot of that’s overblown, researchers have a legitimate reason to feel uncomfortable."
"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."
"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."
"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."
"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."
"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."
"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."
"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."
"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."
"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."
Or choose a question:
More Videos
"Confidence is crucial — nobody wants to lose money or receive a product they can’t use, so unclear or unlabeled controls cause people with disabilities to give up faster."
Sam ProulxOnline Shopping: Designing an Accessible Experience
November 29, 2023
"Not all climate jobs have digital outputs, so don’t waste your time chasing digital roles in fields like green concrete."
Max Gadney Andrea Petrucci Joshua Stehr Hannah WickesAssessing UX jobs for impact in climate
August 14, 2024
"If someone says they don’t want to do this team activity, I say great, you should lead the next one with your idea."
Shipra Kayan Tess DixonHow Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro
October 1, 2021
"We recommend pausing the focus on NPS score to coach behaviors that drive long-term customer relationships."
Bob Baxley Sara Asche Anderson Sharon Bautista Frank Duran Jamie Kaspszak Abbey Smalley Sylas SouzaTheme 4: Discussion
January 8, 2024
"Human tasks will become more complex and multi-dimensional as simple tasks get automated."
Janaki KumarInnovate with Purpose
June 14, 2018
"Rituals symbolize community identity and shared values, helping scale human-centered habits across boundaries."
Lona MooreScaling Design Beyond Designers
June 11, 2021
"You’re never going to convince business people with product language, but you can with financial language they care about."
Giff ConstableFinancial fluency for product leaders: AMA with Giff Constable
April 11, 2024
"Is this enough? Can Civic design do more? There’s a crisis and pressing need for us to evolve our practice."
Meghan Hellstern Joanne DongThe Next 100 Years of Civic Design: How Might We Better Rise to Meet the Challenges of Today and Tomorrow?
December 10, 2021
"Evaluation might be the most important part of your entire development effort and is often the hardest to do well."
Sarah BarrettAI in Real Life: Using LLMs to Turbocharge Microsoft Learn
February 13, 2025
