Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]

Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Interviews remain central but should be complemented with other methods for richer insights.

  • Quantitative techniques like conjoint analysis reveal patterns that interviews alone may miss.

  • Transitioning from structured experiments to interviews often feels uncomfortable but offers new exploration modes.

  • Observational methods such as contextual inquiry uncover users' tacit behaviors and workarounds.

  • Participant comfort and rapport especially matter when dealing with sensitive or high-stakes topics.

  • Mixed methods research benefits from collaboration across different roles, including data analysts and community organizations.

  • Researchers should be pragmatic about time and resources and pick methods fit for purpose and confidence needs.

  • Interviews are often misused as an easy default instead of creatively finding better alternatives.

  • Decentering the researcher and involving community partners leads to more inclusive and authentic data.

  • Researchers must check their own unconscious biases to avoid misinterpreting participant responses.

Notable Quotes

"User interviews are an absolute mainstay of user research practices and likely will always be a core tool."

"Some people lie; that’s why we need to triangulate methods to approach reality."

"Interviews can be a crutch that keeps us from using better ways to answer our questions."

"Allow space for participants to demonstrate expertise before digging deeper in interviews."

"It’s important to put the participant at ease and not add to their cognitive burden."

"People generally want to help and tell what they genuinely believe; they’re just terrible at accurate recall."

"Creativity is needed right from the research stage, not just in solution design."

"The purpose of research is paramount; it guides the choice of methods and how rigorously to apply them."

"If you don’t have researchers to shadow, lean on communities, data scientists, or industry organizations."

"Asking for help and humbling yourself is one of the most powerful ways to grow as a researcher."

Ask the Rosenbot
Meredith Black
Scaling Design Culture
2017 • DesignOps Summit 2017
Gold
Erika Flowers
The Handoff is Dead: Design-Led Engineering with AI Agents
2026 • Rosenfeld Community
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Gold
Frances Yllana
DesignOps Exposed: What do our peers really think of us?
2025 • DesignOps Summit 2025
Gold
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold
Maverick Chan
From Doodle to Demo: AI as Our Storytelling Partner
2025 • Rosenfeld Community
Ilana Lipsett
Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
2021 • Civic Design 2021
Gold
Liwei Dai
The Heart and Brain of the AI Research
2020 • Advancing Research 2020
Gold
Prabhas Pokharel
Order and Chaos: New Ways of Collaborating on Synthesis and Storytelling
2022 • Advancing Research 2022
Gold
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Jeff Gothelf
Who does what by how much?
2025 • Advancing Service Design 2025
Gold
Robert Fabricant
Industry junctures: Paths forwards for UXR and the critical decisions that get us there [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Wendy Johansson
Be a Product Boss!
2022 • Design in Product 2022
Gold
Barb Spanton
Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
2022 • Design at Scale 2022
Gold
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group

More Videos

Maggie Dieringer

"Ship Magic raised the bar on quality across our writer experiences with monthly bugbashes and cross-functional support."

Maggie Dieringer

Creating Consistency Through Constant Change

January 8, 2024

Sam Proulx

"Desktop screen readers can run at speeds up to 800 words per minute because users get used to synthetic speech."

Sam Proulx

Everything You Ever Wanted to Know About Screen Readers

June 11, 2021

"We had to push up the ladder to VP and COO level to get the maker schedule endorsed and mandated."

Panel Discussion: Communicating the Value of DesignOps

November 7, 2018

Carol Massa

"Designers are often perceived as high risk to the business, which conflicts with healthcare’s safety-first mindset."

Carol Massa

Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences

December 3, 2024

Kit Unger

"We are tired of fighting for that seat at the table."

Kit Unger

Theme 1 Intro

June 8, 2022

Changying (Z) Zheng

"Use AI responsibly; never input sensitive info without governance, or it could lead to dangerous outcomes."

Changying (Z) Zheng

Practical DesignOps: From Ideas to Tools That Teams Actually Use

September 25, 2025

Peter Morville

"When we understand organizations as ecosystems, we recognize the need for organic simplicity."

Peter Morville

The Architecture of Understanding

May 13, 2015

Emily Lessard

"No spec work. It’s simply disrespectful to ask small businesses to do unpaid homework."

Emily Lessard

RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent

December 9, 2021

Louis Rosenfeld

"If you talk about the conference in social, please use the eUX 2023 hashtag and help us spread the word."

Louis Rosenfeld

Welcome / Housekeeping

June 7, 2023