Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
In this talk, Wyatt conducts a deep dive into the Airbnb Global Research Panels, the program he has been developing at Airbnb over the past two years. Launch: why Airbnb created the Global Research Panels, the key decisions and the internal alignment required for launching the first version of the Global Research Panel Process: detailed look into the current version of the Global Research Panels, including the mechanics and tools used to manage it Impact: demonstration of ways the Global Research Panels have provided value over the past two years at Airbnb Evolution: see how the Global Research Panels has grown through six iterations so far and the vision for the Global Research Panels program going forward
Key Insights
-
•
Airbnb’s research panels focus on qualitative, not statistically significant, feedback from global users across 60 countries in 11 languages.
-
•
The panels were created to solve the gap of quick access to non-English speakers for product research, as most researchers operate primarily in English.
-
•
Early pilot panels included a mostly English-speaking group in Sydney and a non-English pilot in Tokyo.
-
•
Participants commit to six months with a reward equivalent to $400 US purchasing power, adjusted per country, paid in two parts and contingent on participation.
-
•
Qualtrics’ Target Audience product was chosen for panel management due to existing relationships and capabilities.
-
•
Human translation for surveys and responses is preferred to maintain quality, though machine translation is used occasionally for urgency.
-
•
Panels evolved from complex mechanisms with prototypes and online discussions to simpler survey and remote interview formats to improve operational efficiency.
-
•
Smaller panel sizes (~90 per market) allow for qualitative insights, focusing on proportional representation aligned to Airbnb’s user base in each market.
-
•
Non-research teams at Airbnb have started using the panels for quick feedback without needing to recruit or handle NDAs themselves.
-
•
Future ambitions include expanding live multilingual interviews and integrating more diversity and accessibility data into participant profiles.
Notable Quotes
"Our research operations team’s mission is to let researchers focus on research without worrying about operational details."
"Half of Airbnb’s traffic is from non-English devices and 80% of bookings involve at least one party outside the U.S."
"We ended up piloting a group in Tokyo for non-English speakers, which was key to testing the language challenge."
"Participants are paid based on purchasing power parity — $400 USD equivalent spread over six months for active participation."
"We decided to limit panel access initially to the research team but are exploring expanding to other teams."
"We run a two-week cycle now because translations back and forth require more time for quality."
"The panels are primarily qualitative tools and not meant for statistically significant quantitative research."
"We send out surveys weekly, but respondents have two weeks to answer, accommodating different time zones and bandwidth."
"The panels help researchers test assumptions, check cultural sensitivities, and quickly iterate globally."
"Non-research teams can use the panels easily — one program manager arranged interviews with hosts in 6 countries within a week."
Or choose a question:
More Videos
"Mental health first aiders take on responsibility beyond their role, so we must consider how this affects them."
Brian MossWhat Does it Mean to be a Resilient Research Team?
March 9, 2022
"Do I find a way to make this conversation more about the software as scheduled or do I show Laura how to react to the unplanned?"
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020
"Stories require no learning to understand, but you really have to work to make sense of statistics."
Kwabena Opoku Leonie Annor-Owiredu Sam LadnerMethodological toolkit for unique research impact
March 11, 2026
"Creating clear roadmaps for underrepresented talent shows investment and helps prevent them from being viewed as a means to an end."
Anna Avrekh Amy Jiménez Márquez Morgan C. Ramsey Catarina TsangDiversity In and For Design: Building Conscious Diversity in Design and Research
June 9, 2021
"The equity pause helps you recognize what biases might be present before making decisions impacting lives."
Noah BondRedefining truth and inclusivity: Navigating data ownership and ethical research in the age of disinformation
March 11, 2025
"We don’t use yesterday’s retail playbook to solve problems for today — that’s impossible."
Sara Asche Anderson Jamie KaspszakNot Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
January 8, 2024
"When infrastructure breaks down, it is human infrastructure — communities and organizers — that saves the day."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Users don’t just consume culture anymore; they contribute to it, making cultural understanding essential to UX research."
Soma Ghosh Savina Hawkins Dave Hoffer Rob Thomas Victor UdoewaWhat emerging methods are advancing UX research [Advancing Research Community Workshop Series]
September 28, 2023
"We as researchers have gotten good at delivering answers but lost sight of where the learning loop connects into the bigger organizational context."
Sharon Banh Dave Hora Marieke McCloskey Alicia ZhongReimagining research: What does the field need to grow? [Advancing Research Community Workshop Series]
October 16, 2024
