Rosenverse
Improving Democratized Research with CustomGPTs and Gems

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Improving Democratized Research with CustomGPTs and Gems

Wednesday, February 25, 2026 • Rosenfeld Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
Improving Democratized Research with CustomGPTs and Gems
Speakers: Mike Oren
Link:

Summary

One of the biggest concerns researchers have when having any designer or product manager conduct their own research is that they'll ask biased or bad questions. In theory bad research done by a product team should be accountable to them but since there's a team named "research," that can inevitably fallback on us. We've all offered training to teams at some point but you can lead a horse to water but not force them to drink. Enter AI - your partners will want to use it because it helps them get something they don't usually do (write discussion guides) faster and by writing custom Gems or GPTs, the research team can keep consistency, ensure the AI pushes back in the right way for quality, etc. In this session, I'll cover how to build these and the instruction sets I provide to the tools.

Key Insights

  • Custom AI GPTs can provide guardrails to help non-researchers conduct higher-quality user research.

  • Splitting AI tools into multiple specialized GPTs prevents context overload and hallucinations.

  • Researchers save over 80% of their time by using AI to support routine research planning and execution.

  • Automating recruitment and incentive tracking through Google Sheets and Zapier reduces manual effort.

  • AI can improve research consistency by enforcing unbiased question guidelines and avoiding leading or double-barreled questions.

  • Limitations remain in AI’s ability to synthesize large transcript sets and provide fully accurate quotes.

  • Democratizing research allows product managers and designers to engage more closely with customers while researchers focus on strategic insights.

  • Avoiding shadow AI tools is critical for organizational security and compliance.

  • Video analysis and unmoderated usability testing can now be partially automated using custom GPT Gems.

  • The future of UX research may shift toward researchers providing ‘forest-level’ insights while PMs/designers handle ‘tree-level’ tactical research.

Notable Quotes

"We call ourselves a B2C CRM: helping businesses connect to their consumers and keep the relationship going."

"Before AI, research teams spent over a quarter of their time consulting about research questions, often repeating themselves."

"One of my biggest pet peeves is biased questions; I hate the term validation, I prefer evaluation."

"If we’re not helping with the decision, why are they paying us what they’re paying us? That’s the essence of research."

"We want to make sure researchers spend one hour in office hours, not eight to twelve hours a week helping others."

"Designers and product managers often want more control, and custom AI gives them that in research tasks."

"The tools are meeting people where they’re already going: ChatGPT or Gemini, rather than forcing new platforms."

"Shadow AI usage is a huge security risk in public companies and should be managed by IT and leadership."

"We ask our AI assistants to explicitly avoid leading and double-barreled questions to ensure unbiased research."

"The future is researchers painting the larger picture while PMs and designers focus on deep, tactical user insights."

Ask the Rosenbot
Matt Webb
Context Window: Five Futures for AI
2025 • Designing with AI 2025
Gold
Shan Shen
Translating UX Terms into Business Contexts
2023 • Design in Product 2023
Gold
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community
Ariel Kennan
Theme Two Intro
2022 • Civic Design 2022
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps Summit 2024
Gold
Dan Willis
Enterprise Storytelling Sessions
2016 • Enterprise UX 2016
Gold
Victor Udoewa
Theme One Intro
2023 • Advancing Research 2023
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Louis Rosenfeld
Do you want to work on climate? (Climate UX Discussion Series)
2023 • Climate UX Interest Group
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group
Patrick Boehler
Fishing for Real Needs: Reimagining Journalism Needs with AI
2025 • Designing with AI 2025
Gold
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community

More Videos

Dane DeSutter

"Gesture is not computer and smartphone gestures, but spontaneous movements people make with hands and arms."

Dane DeSutter Stephanie Scopelitis

What co-speech gestures reveal about users’ thinking during interviews

June 30, 2023

Anat Fintzi

"Engineers didn’t understand why they were building what they were building, and product managers didn’t understand what engineers were building."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Eduardo Ortiz

"Organizations are complex, plural, relational systems that require new lenses to understand and influence."

Eduardo Ortiz

Theme 3 Intro

March 13, 2025

Rachael Dietkus, LCSW

"The pressure to produce insights quickly defines many organizations shaped by 'move fast and break things' culture."

Rachael Dietkus, LCSW

The power to heal and harm

March 13, 2025

Sahibzada Mayed

"Does communal proximity guarantee the right to engage in research? This is a complicated question without easy answers."

Sahibzada Mayed

The Politics of Radical Research: A Manifesto

March 27, 2023

Dave Hora

"Helping teams is much more like managing a children’s party than engineering a bridge."

Dave Hora

Research in the Face of Complexity: New Sensibility for New Situations

August 27, 2025

Rikki Teeters

"The traditional handoff between design and engineering is officially dead."

Rikki Teeters

Concept to code: Transforming ideas into functional products with Kiro

June 10, 2026

Sarah Brooks

"Designing a service is really designing a new relationship between government and people, who come with enormous baggage."

Sarah Brooks Jennifer Pahlka

Fireside chat with Sarah Brooks and Jen Pahlka

October 21, 2021

Bria Alexander

"There’s a big discrepancy between accessible consumer AI and what deep research-driven AI can do - Brittany."

Bria Alexander Brittany Hobbs Christopher Noessel

Day 1 Panel: Up to the Minute: The latest in AI’s impact on UX

June 10, 2025