Rosenverse
Anatomy of a Strong User Panel
Conference ticket
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Anatomy of a Strong User Panel
Speakers: Sydney Lawson
Link:

Summary

User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right. In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.

Key Insights

  • Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.

  • Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.

  • Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.

  • Including questions about AI usage and interest helps target relevant participants for specialized research.

  • Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.

  • Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.

  • Panel engagement improves when participants see study results and understand how their feedback influences product decisions.

  • Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.

  • Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.

  • Tracking participant location enables compliance with regional incentive regulations and data privacy laws.

Notable Quotes

"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."

"The most successful way to ask about job function is a single-select question, not an open field."

"We love to see questions around AI and even asking if participants want to join AI studies specifically."

"Incentives are a benefit but should not be the number one reason people join a panel."

"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."

"If you ask accessibility questions, it’s so important to actually respect the answers."

"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."

"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."

"You want your panel to be representative of your customer base, not exactly all your customers."

"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."

Ask the Rosenbot
Alnie Figueroa
The Future of Design Operations: Transforming Our Craft
2025 • DesignOps Summit 2025
Gold
Bud Caddell
Theme 2 Intro
2021 • DesignOps Summit 2021
Gold
Dan Willis
Filling the Void
2018 • DesignOps Summit 2018
Gold
Jen Crim
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Peter Van Dijck
Hands-on AI #2: Understanding evals: LLM as a Judge
2025 • Rosenfeld Community
Brad Orego
Bringing Customer Research to More Internal Teams
2022 • Advancing Research 2022
Gold
Robert Fabricant
Industry junctures: Paths forwards for UXR and the critical decisions that get us there [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Juhan Sonin
Design Now! The Agenda for Action
2025 • Rosenfeld Community
Uday Gajendar
Day 2 Welcome
2024 • Designing with AI 2024
Gold
Gillian Salerno-Rebic
From Insight to Impact: How JourneySpark Used WEVO Pulse + Pro to Drive a 50% Lift in Ad Engagement
2025 • Designing with AI 2025
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Alastair Simpson
Debunking the Myths of Cross-Disciplinary Collaboration
2019 • DesignOps Summit 2019
Gold

More Videos

Gina Mendolia

"Service designers connect the dots, which represent elements, teams, processes, policies, and customer needs that all must align."

Gina Mendolia

Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems

December 3, 2024

Chris Engledowl

"Ethical considerations should go beyond typical privacy reviews and think deeply about user impact throughout the process."

Chris Engledowl

A Mixed Method Approach to Validity to Help Build Trust

April 28, 2023

Etienne Fang

"Leadership is about making other people better as a result of your presence in a way that lasts into our absence."

Etienne Fang

The Power of Care: From Human-Centered Research to Humanity-Centered Leadership

March 10, 2021

Samuel Proulx

"Disability is not a binary, it’s a spectrum."

Samuel Proulx

Designing beyond caricatures: Embracing real, diverse user needs

December 4, 2024

Brian T. O’Neill

"Not everyone using machine learning is your user; think also about the people labeling the data feeding these models."

Brian T. O’Neill Maria Cipollone Luis Colin Manuel Dahm Mike Oren

Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?

February 18, 2022

Barb Spanton

"Shipping smaller, less complex side projects helps build team morale and energizes us for the big slow work."

Barb Spanton

Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'

June 10, 2022

Teresa Swingler

"Design is at the heart of everything we do at Honeywell Aerospace."

Teresa Swingler

Look, Up in the Sky! UX/UI for Aerospace

October 27, 2022

Peter Boersma

"Your metrics allow you to tell data-supported stories to communicate progress effectively."

Peter Boersma

How to Define and Maintain a DesignOps Roadmap

October 3, 2023

Mackenzie Guinon

"Not everyone can become a great UX researcher, but a great UX researcher can come from anywhere."

Mackenzie Guinon

M.C. Escher’s UX Research Career Ladder

March 9, 2022