Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Improving Democratized Research with CustomGPTs and Gems
Wednesday, February 25, 2026 • Rosenfeld Community
Share the love for this talk
Improving Democratized Research with CustomGPTs and Gems
Speakers: Mike Oren
Link:

Summary

One of the biggest concerns researchers have when having any designer or product manager conduct their own research is that they'll ask biased or bad questions. In theory bad research done by a product team should be accountable to them but since there's a team named "research," that can inevitably fallback on us. We've all offered training to teams at some point but you can lead a horse to water but not force them to drink. Enter AI - your partners will want to use it because it helps them get something they don't usually do (write discussion guides) faster and by writing custom Gems or GPTs, the research team can keep consistency, ensure the AI pushes back in the right way for quality, etc. In this session, I'll cover how to build these and the instruction sets I provide to the tools.

Key Insights

  • Custom AI GPTs can provide guardrails to help non-researchers conduct higher-quality user research.

  • Splitting AI tools into multiple specialized GPTs prevents context overload and hallucinations.

  • Researchers save over 80% of their time by using AI to support routine research planning and execution.

  • Automating recruitment and incentive tracking through Google Sheets and Zapier reduces manual effort.

  • AI can improve research consistency by enforcing unbiased question guidelines and avoiding leading or double-barreled questions.

  • Limitations remain in AI’s ability to synthesize large transcript sets and provide fully accurate quotes.

  • Democratizing research allows product managers and designers to engage more closely with customers while researchers focus on strategic insights.

  • Avoiding shadow AI tools is critical for organizational security and compliance.

  • Video analysis and unmoderated usability testing can now be partially automated using custom GPT Gems.

  • The future of UX research may shift toward researchers providing ‘forest-level’ insights while PMs/designers handle ‘tree-level’ tactical research.

Notable Quotes

"We call ourselves a B2C CRM: helping businesses connect to their consumers and keep the relationship going."

"Before AI, research teams spent over a quarter of their time consulting about research questions, often repeating themselves."

"One of my biggest pet peeves is biased questions; I hate the term validation, I prefer evaluation."

"If we’re not helping with the decision, why are they paying us what they’re paying us? That’s the essence of research."

"We want to make sure researchers spend one hour in office hours, not eight to twelve hours a week helping others."

"Designers and product managers often want more control, and custom AI gives them that in research tasks."

"The tools are meeting people where they’re already going: ChatGPT or Gemini, rather than forcing new platforms."

"Shadow AI usage is a huge security risk in public companies and should be managed by IT and leadership."

"We ask our AI assistants to explicitly avoid leading and double-barreled questions to ensure unbiased research."

"The future is researchers painting the larger picture while PMs and designers focus on deep, tactical user insights."

Ask the Rosenbot
Sara Conklin
Exit Interview: 20 Years of Tech, One Very Big Bet, and a Lot of Heat Pumps
2026 • Rosenfeld Community
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Randolph Duke II
War Stories LIVE! Randy Duke II
2020 • Advancing Research 2020
Gold
Anne Mamaghani
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
2023 • Advancing Research 2023
Gold
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops
2022 • Advancing Research Community
Megan Blocker
Theme 2 Intro
2025 • Advancing Research 2025
Gold
Lija Hogan
Doing more with more: Lessons from the Front Lines of Democratization
2022 • Advancing Research 2022
Gold
Nathan Curtis
Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough?
2019 • DesignOps Community
Joshua Graves
We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)
2025 • Rosenfeld Community
Gordon Ross
12 Months of COVID-19 Design and Digital Response with the British Columbia Government
2021 • Civic Design 2021
Gold
Ned Gartside
Navigating accessibility and climate
2024 • Climate UX Interest Group
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Bria Alexander
The Big Question about Resilience: A panel discussion
2024 • DesignOps Summit 2024
Gold
Kara Kane
Theme One Intro
2022 • Civic Design 2022
Gold
Monty Hammontree
The Future of UX Research
2020 • Advancing Research Community
Jen van der Meer
Service design performs value
2025 • Advancing Service Design 2025
Gold

More Videos

Neil Barrie

"We are at an inflection point where what got us here won't necessarily get us to a thriving future."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

George Aye

"The most common way people give up their power is by thinking they don’t have any."

George Aye

That Quiet Little Voice: When Design and Ethics Collide

November 16, 2022

Nicole Bergstrom

"If you want to work with Hilton, you have to bring accessibility to the table like security and privacy."

Nicole Bergstrom Anna Cook Kate Kalcevich Saara Kamppari-Miller

AccessibilityOps: Moving beyond “nice to have”

September 19, 2024

Louis Rosenfeld

"Product managers can feel like they have no say about priorities just like UX practitioners do."

Louis Rosenfeld Christian Crumlish

Opening Remarks

November 29, 2023

Louis Rosenfeld

"Systems thinking is a secret skill UXers have that’s critical for sustainable climate solutions."

Louis Rosenfeld Matt Jones Olga Khroustaleva Michael Leggett Karol Munoz

Do you want to work on climate? (Climate UX Discussion Series)

November 15, 2023

Catherine Dubut

"The constraints in enterprise pushed us to focus more on an employee-centered approach for product decisions."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Kurt McCulloch

"No amount of clearer presentation or communications is going to solve this; it’s a cooperation problem."

Kurt McCulloch

Faster alone, further together: Rebuilding collaboration in the age of AI research

March 10, 2026

Davis Neable

"We formed a core task force empowered to make decisions quickly, avoiding weeks of delay waiting for formal approvals."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Julie Norvaisas

"Collaboration often feels like a mask for entering an unequal relationship with partners."

Julie Norvaisas Pert Eilers Mina Jonsson

Back to basics, or start from scratch?

March 12, 2025