Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Remote User Research: Dos and Don'ts from the Virtual Field
Thursday, June 11, 2020 • Advancing Research Community
Share the love for this talk
Remote User Research: Dos and Don'ts from the Virtual Field
Speakers: Sarah Rink
Link:

Summary

Faced with the coronavirus crisis, the world switched from office to remote work almost overnight. Likewise, many design teams suddenly found themselves having to conduct user research remotely. For some, this wasn't entirely new. For others, it was the first time going all-out remote, which took some getting used to!

Key Insights

  • Remote research suits digital product validation, early concept testing, and asynchronous methods best.

  • Contextual inquiry and ethnography lose critical richness when conducted remotely and are often not worth the effort.

  • Recruitment for remote studies risks biasing samples toward participants with tech access and literacy.

  • Detailed participant screening and pre-interview phone calls help assess vulnerability and stressors during crises like COVID-19.

  • Over recruiting by about 50% compensates well for remote no-shows and tech dropouts.

  • Remote sessions require significantly more preparation time and energy than in-person research.

  • Having formal backup tools and contingency plans is critical to handle inevitable tech failures in remote sessions.

  • Clear rules about stakeholder observers reduce interruptions and emotional impact on participants.

  • Video inclusion in remote interviews builds trust and helps interpret participants’ non-verbal cues.

  • Remote research is not always the best option; sometimes waiting for in-person research is the right call given context and participant conditions.

Notable Quotes

"Remote research is not a silver bullet."

"The best way to understand something is to become part of it."

"If the research question requires deep context, remote probably won’t do."

"It really pays off to prepare way more for remote than for in-person research."

"We recruited 50% more than we needed because no-shows are incredible in remote sessions."

"Video conveys trust and lets you see those purposeful pauses."

"Observers interrupting sessions was a weird behavior we had to manage with clear rules."

"Having a recruitment team that does pre-session phone screenings was a luxury that helped a lot."

"Don’t do remote contextual inquiry just because you can; you lose so much context."

"Remote is a design constraint, but what else can we do with it to improve practice?"

Ask the Rosenbot
Amy Paris
Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities
2021 • Civic Design 2021
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Alana Washington
Theme 1: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Isaac Heyveld
Expand DesignOps Leadership as a Chief of Staff
2022 • DesignOps Summit 2022
Gold
Llewyn Paine
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
2025 • Advancing Research 2025
Gold
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Peter Van Dijck
Hands-on AI #2: Understanding evals: LLM as a Judge
2025 • Rosenfeld Community
Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Boon Yew Chew
Making Sense of Systems—and Using Systems to Make Sense of the Enterprise
2023 • Enterprise UX 2023
Gold
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group
Louis Rosenfeld
Day 1 Welcome
2024 • DesignOps Summit 2024
Gold
John Cutler
The Alignment Trap
2023 • Design in Product 2023
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold

More Videos

Sam Proulx

"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

December 9, 2021

Michael Land

"There are lots of little mushroom patches of design sprouting up, but they're disconnected and not sharing."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Shipra Kayan

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Ian Swinson

"Innovation is about being fearless, breaking rules, and refusing to stop at the way things have always been done."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Isaac Heyveld

"The chief of staff is the bridge between our executive leadership team and the design ops practitioners."

Isaac Heyveld

Expand DesignOps Leadership as a Chief of Staff

September 8, 2022

Amy Evans

"Self-service was a model with the most unknowns but possibly the biggest rewards."

Amy Evans

How to Create Change

September 25, 2024

Kate Koch

"Flight is about adaptability – being ready to switch gears and pivot quickly in a global and changing environment."

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Dave Gray

"The only way to get outside your bubble is to act as if an alternative belief is true and test it."

Dave Gray

Liminal Thinking: Sense-making for systems in large organizations

May 14, 2015

Matt Duignan

"What if the atomic unit of research wasn’t the reports, but it was the insight within those reports?"

Matt Duignan

Atomizing Research: Trend or Trap

March 30, 2020