Rosenverse

Anatomy of a Strong User Panel

Gold
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Anatomy of a Strong User Panel
Speakers: Sydney Lawson
Link:

Summary

User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right. In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.

Key Insights

  • Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.

  • Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.

  • Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.

  • Including questions about AI usage and interest helps target relevant participants for specialized research.

  • Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.

  • Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.

  • Panel engagement improves when participants see study results and understand how their feedback influences product decisions.

  • Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.

  • Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.

  • Tracking participant location enables compliance with regional incentive regulations and data privacy laws.

Notable Quotes

"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."

"The most successful way to ask about job function is a single-select question, not an open field."

"We love to see questions around AI and even asking if participants want to join AI studies specifically."

"Incentives are a benefit but should not be the number one reason people join a panel."

"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."

"If you ask accessibility questions, it’s so important to actually respect the answers."

"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."

"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."

"You want your panel to be representative of your customer base, not exactly all your customers."

"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."

Ask the Rosenbot
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps Summit 2024
Gold
Jen van der Meer
Service design performs value
2025 • Advancing Service Design 2025
Gold
Rachel Posman
"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors
2024 • DesignOps Summit 2024
Gold
Sam Proulx
Everything You Ever Wanted to Know About Screen Readers
2021 • Design at Scale 2021
Gold
Dawn Ressel
Full-Stack User Experiences: A Marriage of Design and Technology
2016 • Enterprise UX 2016
Gold
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community
Darian Davis
Lessons from a Toxic Work Relationship
2024 • Enterprise Experience 2020
Gold
Dave Hora
Research in the Face of Complexity: New Sensibility for New Situations
2025 • Rosenfeld Community
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Prabhas Pokharel
Order and Chaos: New Ways of Collaborating on Synthesis and Storytelling
2022 • Advancing Research 2022
Gold

More Videos

Kate Towsey

"Building ecosystems of interconnected tools that work seamlessly is crucial for modern, fast-moving organizations."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Harry Max

"Your priorities don’t tell you what to do — your judgment makes the decisions."

Harry Max Jim Meyer

Prioritization for Leaders (2nd of 3 seminars)

June 27, 2024

Catherine Dubut

"Being able to see faces and first names of people we're learning from makes those users tangible to the team."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Christopher Taylor Edwards

"If you have an unmet need, pairing can help address it by matching offers and needs within the team."

Christopher Taylor Edwards Valerie Roske

Design as a Team Practice, A Practical Guide to Cross-functional Collaboration

September 30, 2021

Kate Kalcevich

"Personas tend to not give you those deep insights that you would get from user research and user testing."

Kate Kalcevich

Designing inclusively with AI

June 5, 2024

Sarah Barrett

"An everything chat bot is almost certainly not how you’re going to build it; realistically you’re building three apps in a trench coat."

Sarah Barrett

AI in Real Life: Using LLMs to Turbocharge Microsoft Learn

February 13, 2025

Frances Yllana

"There’s a fine line between a service mindset and saviorism — am I helping communities or using them to feel superior?"

Frances Yllana Ann Buechner Jess Jones Betsy Ramaccia

D.E.A.R.R. Diaries (Discipline, Experience, Architecture, Reflection + Revolution)

November 16, 2022

Jaskiran Kang

"Lou Down made a call for good designers to come and join government, and that was my eye-opening moment."

Jaskiran Kang

Why Community is Key to Professionalizing Design

October 28, 2022

Jacqui Frey

"Move softly and fix things."

Jacqui Frey Alison Rand

Setting the Table for Dynamic Change

October 24, 2019