Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Improving Democratized Research with CustomGPTs and Gems
This video is featured in the AI Trends in User Research playlist.
Summary
One of the biggest concerns researchers have when having any designer or product manager conduct their own research is that they'll ask biased or bad questions. In theory bad research done by a product team should be accountable to them but since there's a team named "research," that can inevitably fallback on us. We've all offered training to teams at some point but you can lead a horse to water but not force them to drink. Enter AI - your partners will want to use it because it helps them get something they don't usually do (write discussion guides) faster and by writing custom Gems or GPTs, the research team can keep consistency, ensure the AI pushes back in the right way for quality, etc. In this session, I'll cover how to build these and the instruction sets I provide to the tools.
Key Insights
-
•
Custom AI GPTs can provide guardrails to help non-researchers conduct higher-quality user research.
-
•
Splitting AI tools into multiple specialized GPTs prevents context overload and hallucinations.
-
•
Researchers save over 80% of their time by using AI to support routine research planning and execution.
-
•
Automating recruitment and incentive tracking through Google Sheets and Zapier reduces manual effort.
-
•
AI can improve research consistency by enforcing unbiased question guidelines and avoiding leading or double-barreled questions.
-
•
Limitations remain in AI’s ability to synthesize large transcript sets and provide fully accurate quotes.
-
•
Democratizing research allows product managers and designers to engage more closely with customers while researchers focus on strategic insights.
-
•
Avoiding shadow AI tools is critical for organizational security and compliance.
-
•
Video analysis and unmoderated usability testing can now be partially automated using custom GPT Gems.
-
•
The future of UX research may shift toward researchers providing ‘forest-level’ insights while PMs/designers handle ‘tree-level’ tactical research.
Notable Quotes
"We call ourselves a B2C CRM: helping businesses connect to their consumers and keep the relationship going."
"Before AI, research teams spent over a quarter of their time consulting about research questions, often repeating themselves."
"One of my biggest pet peeves is biased questions; I hate the term validation, I prefer evaluation."
"If we’re not helping with the decision, why are they paying us what they’re paying us? That’s the essence of research."
"We want to make sure researchers spend one hour in office hours, not eight to twelve hours a week helping others."
"Designers and product managers often want more control, and custom AI gives them that in research tasks."
"The tools are meeting people where they’re already going: ChatGPT or Gemini, rather than forcing new platforms."
"Shadow AI usage is a huge security risk in public companies and should be managed by IT and leadership."
"We ask our AI assistants to explicitly avoid leading and double-barreled questions to ensure unbiased research."
"The future is researchers painting the larger picture while PMs and designers focus on deep, tactical user insights."
Or choose a question:
More Videos
"Design without implementation is just theory; feedback loops must turn user needs into action."
Ed MullenDesigning the Unseen: Enabling Institutions to Build Public Trust
November 16, 2022
"I suspect there are specific tasks we could support more effectively with dedicated tools."
Andrea GallagherThe Problem Space
May 16, 2019
"Our past enablement was exacerbating issues because teams had resources but not enough skills."
Elizabeth Sklar Jessica ShengCo-creating research enablement with your tech org: a case study
March 10, 2026
"I was more than an information architect, I was an information therapist."
Louis RosenfeldWelcome / Housekeeping
June 6, 2023
"We had to kill the Ask Alexis product because the level of commitment needed couldn't happen with part-time consultants."
Steve Sanderson Alissa Briggs Jeff Gothelf Bill ScottDiscussion
May 14, 2015
"Democratization has already happened; the conversation should focus on the nuanced middle ground."
Aras Bilgen Ari ZelmanowResearch Democratization: A Debate
March 29, 2023
"Multilingual embedding models can cluster similar meanings across languages in a shared latent space."
Ian JohnsonLatent Scope: Finding structure in unstructured data
June 11, 2025
"Adversity is part of the human condition—what matters is how we face it, because that gives life greater meaning."
Brendan JarvisIt was the Best of Times. It was the Worst of Times.
September 25, 2024
"My screener automatically reads out all incoming messages into my headphones, so I hear my voice, the Zoom messages, the speaker notes, and the slides all at once."
Sam ProulxOnline Shopping: Designing an Accessible Experience
November 29, 2023
Latest Books All books
Dig deeper with the Rosenbot
How can emerging communities of practice support designers and facilitators working with social complexity?
What practical advice does Kritika give for working with AI as a collaborator in unfamiliar design areas?
How does AI involvement improve the quality and relevance of questions asked during SME review sessions?