Summary
As culture and technology evolve, researchers must learn to co-exist with AI. Understanding its benefits, limitations, and ethical challenges is essential. This guide offers practical insights on top AI tools, advice on when and how to integrate AI into workflows, and a balanced view of the good, the bad and the ugly of the current AI landscape.
Key Insights
-
•
AI is shifting the authoritative voice in research from humans to generative models, challenging researchers’ traditional value.
-
•
Framing research value by sheer output risks commoditizing the field and losing long-term business impact.
-
•
Measuring research impact through concrete business outcomes is harder but essential for sustaining researcher relevance.
-
•
Research integrity is at risk if AI adoption isn't rigorously tested, as stakeholders expect researchers to model best practices.
-
•
AI tools can introduce biases especially affecting marginalized groups, impacting fairness in user research.
-
•
User researchers’ specialized skills in navigating complex trade-offs uniquely position them to integrate AI responsibly.
-
•
The lack of standardized methods for using AI in social science research makes learning from engineers and scientists critical.
-
•
Human data collection remains irreplaceable due to AI's weaknesses in understanding niche cultures and novel insights.
-
•
AI enables researchers to extend beyond study execution into prototyping, impact tracing, and direct product decision influence.
-
•
The rise of AI-powered 'triple threat' researchers combines research, product management, and design augmented by AI capabilities.
Notable Quotes
"Right now, there’s a fear of being replaced by AI, and while a lot of that’s overblown, researchers have a legitimate reason to feel uncomfortable."
"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."
"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."
"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."
"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."
"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."
"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."
"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."
"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."
"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."
Or choose a question:
More Videos
"Design Quality Scores look at all touchpoints, emotional interactions, and the cognitive journey to fine-tune product adoption."
Todd Healy Jess GrecoDriving Change with CX Metrics
June 7, 2023
"The experience comes together when all systems and departments are synchronized in one place."
Satyam KantamneniDo You Have an Experience Vision?
March 23, 2023
"Supporting designers with basic tools like a working laptop can be surprisingly complex but hugely impacts efficiency."
Jose Coronado Julie Gitlin Lawrence LipkinPeople First - Design at JP Morgan
June 10, 2021
"We must talk like business people, not just designers."
Stephen PollardClosing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
November 7, 2017
"We often point fingers at the person making the most money from the mess that designers put through the system."
Cennydd Bowles Dan Rosenberg Lisa WelchmanDay 1 Panel
June 4, 2024
"By connecting complex user journeys to queries, we made the impact on business bottom lines explicit and compelling."
Mac SmithMeasuring Up: Using Product Research for Organizational Impact
March 12, 2021
"The effect you have on others is the most valuable currency there is."
Melissa Eggleston Maya Israni Florence Kasule Owen Seely Andrea SchneiderPractical People Skills for Building Trust on Teams and with Partners
December 9, 2021
"Nobody knows what design ops is."
Dianne QueReal Talk: Proving Value through a Scrappy Playbook
October 23, 2019
"Accessibility is not only important to preserve rights but leads directly to innovation."
Sam ProulxTo Boldly Go: The New Frontiers of Accessibility
June 10, 2022
