Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Improving Democratized Research with CustomGPTs and Gems
Wednesday, February 25, 2026 • Rosenfeld Community
Share the love for this talk
Improving Democratized Research with CustomGPTs and Gems
Speakers: Mike Oren
Link:

Summary

One of the biggest concerns researchers have when having any designer or product manager conduct their own research is that they'll ask biased or bad questions. In theory bad research done by a product team should be accountable to them but since there's a team named "research," that can inevitably fallback on us. We've all offered training to teams at some point but you can lead a horse to water but not force them to drink. Enter AI - your partners will want to use it because it helps them get something they don't usually do (write discussion guides) faster and by writing custom Gems or GPTs, the research team can keep consistency, ensure the AI pushes back in the right way for quality, etc. In this session, I'll cover how to build these and the instruction sets I provide to the tools.

Key Insights

  • Custom AI GPTs can provide guardrails to help non-researchers conduct higher-quality user research.

  • Splitting AI tools into multiple specialized GPTs prevents context overload and hallucinations.

  • Researchers save over 80% of their time by using AI to support routine research planning and execution.

  • Automating recruitment and incentive tracking through Google Sheets and Zapier reduces manual effort.

  • AI can improve research consistency by enforcing unbiased question guidelines and avoiding leading or double-barreled questions.

  • Limitations remain in AI’s ability to synthesize large transcript sets and provide fully accurate quotes.

  • Democratizing research allows product managers and designers to engage more closely with customers while researchers focus on strategic insights.

  • Avoiding shadow AI tools is critical for organizational security and compliance.

  • Video analysis and unmoderated usability testing can now be partially automated using custom GPT Gems.

  • The future of UX research may shift toward researchers providing ‘forest-level’ insights while PMs/designers handle ‘tree-level’ tactical research.

Notable Quotes

"We call ourselves a B2C CRM: helping businesses connect to their consumers and keep the relationship going."

"Before AI, research teams spent over a quarter of their time consulting about research questions, often repeating themselves."

"One of my biggest pet peeves is biased questions; I hate the term validation, I prefer evaluation."

"If we’re not helping with the decision, why are they paying us what they’re paying us? That’s the essence of research."

"We want to make sure researchers spend one hour in office hours, not eight to twelve hours a week helping others."

"Designers and product managers often want more control, and custom AI gives them that in research tasks."

"The tools are meeting people where they’re already going: ChatGPT or Gemini, rather than forcing new platforms."

"Shadow AI usage is a huge security risk in public companies and should be managed by IT and leadership."

"We ask our AI assistants to explicitly avoid leading and double-barreled questions to ensure unbiased research."

"The future is researchers painting the larger picture while PMs and designers focus on deep, tactical user insights."

Ask the Rosenbot
Matt Bernius
Trauma-informed Research: A Panel Discussion
2021 • Advancing Research Community
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Advancing Research 2022
Gold
Amy Brana Stuart
Rest in Peace Fly-in-fly-out Design
2022 • Design at Scale 2022
Gold
Cheryl Platz
Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing
2024 • Rosenfeld Community
Sarah Brooks
Theme 3 Intro
2021 • Civic Design 2021
Gold
Mariah Hay
Ethics in Tech Education: Designing to Provide Opportunity for All
2018 • Enterprise Experience 2018
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
John Cutler
Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
2024 • Advancing Service Design 2024
Gold
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
Dr. Jamika D. Burge
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Tina Weisser
When AI Agents Meet Reality. Service Design Lessons from a Pilot
2026 • Rosenfeld Community
Surya Vanka
Unleashing Swarm Creativity to Solve Enterprise Challenges
2021 • Design at Scale 2021
Gold
Erika Flowers
The Handoff is Dead: Design-Led Engineering with AI Agents
2026 • Rosenfeld Community
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group
Aletheia Delivre
New Shapes and Emerging Identities for Design Ops
2025 • DesignOps Summit 2025
Gold

More Videos

Alnie Figueroa

"Once people get design ops, they will go to your design ops leader, and that’s when design ops becomes critical for scaling smart with minimal churn."

Alnie Figueroa

Teamwork: Strategies for Effective Collaboration with Other Program Management Teams

September 8, 2022

Jen Crim

"Embrace diversity and create belonging means everyone feels they truly belong, not just fit in."

Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani Pahwa

Culture, DIBS & Recruiting

June 11, 2021

Dave Malouf

"Minimum lovable product is a better focus than minimum viable product in design ops to deliver meaningful impact early."

Dave Malouf Adrienne Allnutt Jon Fukuda Dominique Ward

The Future of DesignOps

January 8, 2024

Kate Towsey

"You can own the infrastructure that allows knowledge to flow but you can't actually own the knowledge itself."

Kate Towsey

Ask Me Anything (AMA) with Kate Towsey

April 2, 2025

Laura Weiss

"The alternate to engaging with conflict is suffering quietly or accumulating conflict debt."

Laura Weiss

Turn Down the Heat: 3 Ways to Handle Conflict in the Moment

November 20, 2024

Jacqui Frey

"We haven’t just invited them, we’ve set the damn table, and sometimes we have to host the damn party."

Jacqui Frey Alison Rand

Setting the Table for Dynamic Change

October 24, 2019

Taiye Akin-Akinyosoye

"Managing a loud participant is not about dimming their voice but ensuring other voices are heard too."

Taiye Akin-Akinyosoye

Amplifying voices and enhancing user research through group interviews

March 12, 2025

Roy Opata Olende

"User research can sound intimidating, so our first step was to make it simpler and more approachable."

Roy Opata Olende

How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users

August 6, 2020

Robert Fabricant

"Knowledge sits on a shelf. Understanding is an active way to engage and connect people."

Robert Fabricant

Shifting dynamics: The evolving relationship between researchers, participants, and organizational systems

March 11, 2025