Rosenverse
Global Research Panels

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Global Research Panels

Saturday, August 8, 2020 • DesignOps Community
Share the love for this talk
Global Research Panels
Speakers: Wyatt Hayman
Link:

Summary

In this talk, Wyatt conducts a deep dive into the Airbnb Global Research Panels, the program he has been developing at Airbnb over the past two years. Launch: why Airbnb created the Global Research Panels, the key decisions and the internal alignment required for launching the first version of the Global Research Panel Process: detailed look into the current version of the Global Research Panels, including the mechanics and tools used to manage it Impact: demonstration of ways the Global Research Panels have provided value over the past two years at Airbnb Evolution: see how the Global Research Panels has grown through six iterations so far and the vision for the Global Research Panels program going forward

Key Insights

  • Airbnb’s research panels focus on qualitative, not statistically significant, feedback from global users across 60 countries in 11 languages.

  • The panels were created to solve the gap of quick access to non-English speakers for product research, as most researchers operate primarily in English.

  • Early pilot panels included a mostly English-speaking group in Sydney and a non-English pilot in Tokyo.

  • Participants commit to six months with a reward equivalent to $400 US purchasing power, adjusted per country, paid in two parts and contingent on participation.

  • Qualtrics’ Target Audience product was chosen for panel management due to existing relationships and capabilities.

  • Human translation for surveys and responses is preferred to maintain quality, though machine translation is used occasionally for urgency.

  • Panels evolved from complex mechanisms with prototypes and online discussions to simpler survey and remote interview formats to improve operational efficiency.

  • Smaller panel sizes (~90 per market) allow for qualitative insights, focusing on proportional representation aligned to Airbnb’s user base in each market.

  • Non-research teams at Airbnb have started using the panels for quick feedback without needing to recruit or handle NDAs themselves.

  • Future ambitions include expanding live multilingual interviews and integrating more diversity and accessibility data into participant profiles.

Notable Quotes

"Our research operations team’s mission is to let researchers focus on research without worrying about operational details."

"Half of Airbnb’s traffic is from non-English devices and 80% of bookings involve at least one party outside the U.S."

"We ended up piloting a group in Tokyo for non-English speakers, which was key to testing the language challenge."

"Participants are paid based on purchasing power parity — $400 USD equivalent spread over six months for active participation."

"We decided to limit panel access initially to the research team but are exploring expanding to other teams."

"We run a two-week cycle now because translations back and forth require more time for quality."

"The panels are primarily qualitative tools and not meant for statistically significant quantitative research."

"We send out surveys weekly, but respondents have two weeks to answer, accommodating different time zones and bandwidth."

"The panels help researchers test assumptions, check cultural sensitivities, and quickly iterate globally."

"Non-research teams can use the panels easily — one program manager arranged interviews with hosts in 6 countries within a week."

Ask the Rosenbot
Harry Max
Priority Zero: Some Things are More Equal than Others
2016 • Enterprise UX 2016
Gold
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Charlotte Vorbeck
Pipeline to Civic Design
2021 • Civic Design 2021
Gold
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold
Fredrik Matheson
First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.
2016 • Enterprise UX 2016
Gold
Tom Armitage
Day 2 Panel: Looking ahead: Designing with AI in 2026
2025 • Designing with AI 2025
Gold
Dave Malouf
Closing Keynote: Amplify. Not Optimize.
2019 • DesignOps Summit 2019
Gold
Louis Rosenfeld
Do you want to work on climate? (Climate UX Discussion Series)
2023 • Climate UX Interest Group
Jon Fukuda
All the Ops: Successful cross-functional collaboration
2025 • DesignOps Summit 2025
Gold
Aiyana Bodi
Three Key Climate Initiatives and How You Can Help
2024 • Climate UX Interest Group
Abbey Smalley
Today’s Design Ops and Programs Landscape & Career Paths
2023 • DesignOps Summit 2023
Gold
Sahibzada Mayed
The Politics of Radical Research: A Manifesto
2023 • Advancing Research 2023
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion
2021 • DesignOps Community

More Videos

Todd Healy

"Partner Onboarding Gold Standards act like a carrot-shaped stick tied to executive bonuses to push speed to revenue without sacrificing quality."

Todd Healy Jess Greco

Driving Change with CX Metrics

June 7, 2023

David Cronin

"I start by going and talking to the people, the end users, and the subject matter experts who have been working in the field for decades."

David Cronin Uday Gajendar Peter Morville Kendra Shimmell

Discussion

May 13, 2015

Kevin M. Hoffman

"Having a business background is almost the oldest form of product management, but great product requires balancing design and tech too."

Kevin M. Hoffman

Theme 2: Enterprise Team Journey

June 3, 2019

Dalia El-Shimy

"The single most important thing we can do at the table is expanding the boundaries of knowledge for decision makers."

Dalia El-Shimy

So You've Got a Seat at the Table. Now What?

March 31, 2020

Bria Alexander

"This is a conference where you can stand up and people will see you do that — which we haven’t had in the past."

Bria Alexander Louis Rosenfeld

Opening Remarks Day 1

March 25, 2024

Jon Fukuda

"This just goes on — resource and time budgeting, delivery management, and that is just the surface."

Jon Fukuda

Theme One Intro

September 8, 2022

Clemens Janssen

"Without buy-in, you can’t get budgets approved or tools put in place to grow research practices."

Clemens Janssen Jane Davis

Efficiently Scaling Research as a Team of One

March 28, 2023

Christian Madsbjerg

"Managing up assumes research is below something, but I see advising as partnerships and equals."

Christian Madsbjerg

Influencing Strategy

March 31, 2020

Sam Proulx

"Accessible mobile designs can be reused on desktop, but desktop-first accessibility is harder to transfer to mobile."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

September 8, 2022