Rosenverse
Global Research Panels

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Global Research Panels

Saturday, August 8, 2020 • DesignOps Community
Share the love for this talk
Global Research Panels
Speakers: Wyatt Hayman
Link:

Summary

In this talk, Wyatt conducts a deep dive into the Airbnb Global Research Panels, the program he has been developing at Airbnb over the past two years.
  • Launch: why Airbnb created the Global Research Panels, the key decisions and the internal alignment required for launching the first version of the Global Research Panel
  • Process: detailed look into the current version of the Global Research Panels, including the mechanics and tools used to manage it
  • Impact: demonstration of ways the Global Research Panels have provided value over the past two years at Airbnb
  • Evolution: see how the Global Research Panels has grown through six iterations so far and the vision for the Global Research Panels program going forward

Key Insights

  • •

    Airbnb’s research panels focus on qualitative, not statistically significant, feedback from global users across 60 countries in 11 languages.

  • •

    The panels were created to solve the gap of quick access to non-English speakers for product research, as most researchers operate primarily in English.

  • •

    Early pilot panels included a mostly English-speaking group in Sydney and a non-English pilot in Tokyo.

  • •

    Participants commit to six months with a reward equivalent to $400 US purchasing power, adjusted per country, paid in two parts and contingent on participation.

  • •

    Qualtrics’ Target Audience product was chosen for panel management due to existing relationships and capabilities.

  • •

    Human translation for surveys and responses is preferred to maintain quality, though machine translation is used occasionally for urgency.

  • •

    Panels evolved from complex mechanisms with prototypes and online discussions to simpler survey and remote interview formats to improve operational efficiency.

  • •

    Smaller panel sizes (~90 per market) allow for qualitative insights, focusing on proportional representation aligned to Airbnb’s user base in each market.

  • •

    Non-research teams at Airbnb have started using the panels for quick feedback without needing to recruit or handle NDAs themselves.

  • •

    Future ambitions include expanding live multilingual interviews and integrating more diversity and accessibility data into participant profiles.

Notable Quotes

"Our research operations team’s mission is to let researchers focus on research without worrying about operational details."

"Half of Airbnb’s traffic is from non-English devices and 80% of bookings involve at least one party outside the U.S."

"We ended up piloting a group in Tokyo for non-English speakers, which was key to testing the language challenge."

"Participants are paid based on purchasing power parity — $400 USD equivalent spread over six months for active participation."

"We decided to limit panel access initially to the research team but are exploring expanding to other teams."

"We run a two-week cycle now because translations back and forth require more time for quality."

"The panels are primarily qualitative tools and not meant for statistically significant quantitative research."

"We send out surveys weekly, but respondents have two weeks to answer, accommodating different time zones and bandwidth."

"The panels help researchers test assumptions, check cultural sensitivities, and quickly iterate globally."

"Non-research teams can use the panels easily — one program manager arranged interviews with hosts in 6 countries within a week."

Ask the Rosenbot
Maria Giudice
Becoming a Changemaker by Leading with Design
2023 • Advancing Research 2023
Gold
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Ryan Matthew
Bridging Design and Code: AI-Powered Design System Integration
2025 • Rosenfeld Community
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • Advancing Service Design 2025
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold
Reginé Gilbert
Asking the Right Questions: Life, Hope and Moving Forward During the Pandemic
2022 • Design at Scale 2022
Gold
Eduardo Ortiz
Theme 3 Intro
2025 • Advancing Research 2025
Gold
Natalie Dunbar
DesignOps and Content Strategy: Envisioning the Future Together
2021 • DesignOps Summit 2021
Gold
Prayag Narula
How to Empower Your Designers to Do Good Research – And Why You Want To
2022 • Design at Scale 2022
Gold
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge
2019 • Advancing Research Community
Abby Covert
Is the shift greater than the sum of its parts?
2026 • Shift UX 2026
Conference
Holly Cole
Panel Discussion: Growing People and Teams
2018 • DesignOps Summit 2018
Gold
JD Buckley
COMMUNICATE: Discussion
2018 • Enterprise Experience 2018
Gold
Lais de Almeida
Designing Data Services
2024 • Advancing Service Design 2024
Gold

More Videos

Louis Rosenfeld

"We've worked with speakers for months to prepare our conference content, so it's expensive to produce, but really good."

Louis Rosenfeld

About the Rosenverse

March 15, 2026

Ilana Lipsett

"Whoever has been and might continue to be the most negatively impacted absolutely needs to be centered and have their voices at the table."

Ilana Lipsett

Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance

December 10, 2021

Aletheia Delivre

"Ego death is a painful, almost burial-like process of letting go of aspects that have become our identity over decades."

Aletheia Delivre

New Shapes and Emerging Identities for Design Ops

September 11, 2025

Kristin Sundermeyer

"We didn't actually overspend our budget. The allocations simply fell short of our expenditure."

Kristin Sundermeyer Tygre Morehart

Design Ops Metrics

September 30, 2021

Bria Alexander

"Please respect our code of conduct to ensure a welcoming and safe space for all attendees."

Bria Alexander

Opening Remarks

March 28, 2023

Candace Myers

"The Cheesecake Factory has basically cracked the code across what I am deeming four tenets of standardization at scale: quality, scope, velocity, and craft."

Candace Myers

Standardizing Design at Scale

September 9, 2022

Courtney Kaplan

"My team felt lonely—like lone wolves being the only one of their kind on their teams."

Courtney Kaplan

Taking it to the next level: Career paths in DesignOps

November 8, 2018

Mike Oren

"Designers and product managers often want more control, and custom AI gives them that in research tasks."

Mike Oren

Improving Democratized Research with CustomGPTs and Gems

February 25, 2026

Erika Flowers

"The old way is over. It's over."

Erika Flowers

The Handoff is Dead: Design-Led Engineering with AI Agents

March 4, 2026

Latest Books All books