Rosenverse

Anatomy of a Strong User Panel

Gold
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Anatomy of a Strong User Panel
Speakers: Sydney Lawson
Link:

Summary

User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right. In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.

Key Insights

  • Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.

  • Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.

  • Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.

  • Including questions about AI usage and interest helps target relevant participants for specialized research.

  • Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.

  • Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.

  • Panel engagement improves when participants see study results and understand how their feedback influences product decisions.

  • Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.

  • Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.

  • Tracking participant location enables compliance with regional incentive regulations and data privacy laws.

Notable Quotes

"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."

"The most successful way to ask about job function is a single-select question, not an open field."

"We love to see questions around AI and even asking if participants want to join AI studies specifically."

"Incentives are a benefit but should not be the number one reason people join a panel."

"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."

"If you ask accessibility questions, it’s so important to actually respect the answers."

"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."

"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."

"You want your panel to be representative of your customer base, not exactly all your customers."

"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."

Ask the Rosenbot
Alan Williams
Designing essential financial services for those in need
2022 • Civic Design Community
Mandy Drew
What Role(s) Can Research Play in Responsible Design?
2021 • Advancing Research 2021
Gold
Megan Blocker
What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Megan Blocker
Day 2 Theme Panel
2025 • Advancing Research 2025
Gold
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps Summit 2024
Gold
Jemma Ahmed
Redefining the research toolkit: Expanding methodologies for a changing world
2025 • Advancing Research 2025
Gold
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Robin Beers
Navigating organizational systems: Rethinking researcher’s role in driving change
2025 • Advancing Research 2025
Gold
Jeff Gothelf
Innovation Studios: the Engines of Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Luke Roberts
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Roberta Dombrowski
Making Research a Team Sport
2022 • Advancing Research 2022
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Wendy Johansson
Be a Product Boss!
2022 • Design in Product 2022
Gold
Laura Smith
Embedding Service Design and Agile Practice within UK Planning Teams to Create Services that Last
2024 • Advancing Service Design 2024
Gold
Bria Alexander
Day 2 Welcome
2024 • DesignOps Summit 2024
Gold

More Videos

Natalia Radywyl

"Sovereignty was never ceded."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Changying (Z) Zheng

"When operations do their job well, people don’t even know it exists until something breaks."

Changying (Z) Zheng

Practical DesignOps: From Ideas to Tools That Teams Actually Use

September 25, 2025

Laura Smith

"Procurement in local government favors old, single-sale products, making adoption of new services challenging despite long-term savings."

Laura Smith Tom Gayler

Embedding Service Design and Agile Practice within UK Planning Teams to Create Services that Last

December 3, 2024

Alla Weinberg

"If there isn’t safety and connection, you get a culture of transaction and silence that kills innovation."

Alla Weinberg

Design Teams Need Psychological Safety: Here’s How to Create It

September 8, 2022

Brigette Metzler

"Lifting your game above the day to day is impossible without ops."

Brigette Metzler

Scaling ResearchOps: Helping Researchers do Their Best Work

March 30, 2020

Sarah Alvarado

"The more you worry about every question not being answered, the more it distracts from influencing what matters most."

Sarah Alvarado Nalini P. Kotamraju Anne Mamaghani Peter Merholz

How to make UX research leadership more effective [Advancing Research Community Workshop Series]

October 26, 2023

Lisanne Norman

"At Dell, 90% of my design team was white and overwhelmingly male—a sharp contrast from my earlier team."

Lisanne Norman

Why I Left Research

March 27, 2023

Ren Pope

"There needs to be some sort of universal standard for sourcing or mapping how the knowledge was obtained."

Ren Pope

Building Experiences for Knowledge Systems

June 6, 2023

Malini Rao

"No two re-platforming journeys are exactly the same, and there isn't one single formula that works every time."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021