Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Interviews remain central but should be complemented with other methods for richer insights.

  • Quantitative techniques like conjoint analysis reveal patterns that interviews alone may miss.

  • Transitioning from structured experiments to interviews often feels uncomfortable but offers new exploration modes.

  • Observational methods such as contextual inquiry uncover users' tacit behaviors and workarounds.

  • Participant comfort and rapport especially matter when dealing with sensitive or high-stakes topics.

  • Mixed methods research benefits from collaboration across different roles, including data analysts and community organizations.

  • Researchers should be pragmatic about time and resources and pick methods fit for purpose and confidence needs.

  • Interviews are often misused as an easy default instead of creatively finding better alternatives.

  • Decentering the researcher and involving community partners leads to more inclusive and authentic data.

  • Researchers must check their own unconscious biases to avoid misinterpreting participant responses.

Notable Quotes

"User interviews are an absolute mainstay of user research practices and likely will always be a core tool."

"Some people lie; that’s why we need to triangulate methods to approach reality."

"Interviews can be a crutch that keeps us from using better ways to answer our questions."

"Allow space for participants to demonstrate expertise before digging deeper in interviews."

"It’s important to put the participant at ease and not add to their cognitive burden."

"People generally want to help and tell what they genuinely believe; they’re just terrible at accurate recall."

"Creativity is needed right from the research stage, not just in solution design."

"The purpose of research is paramount; it guides the choice of methods and how rigorously to apply them."

"If you don’t have researchers to shadow, lean on communities, data scientists, or industry organizations."

"Asking for help and humbling yourself is one of the most powerful ways to grow as a researcher."

Ask the Rosenbot
Cassini Nazir
The Dangers of Empathy: Toward More Responsible Design Research
2023 • Advancing Research 2023
Gold
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young
2019 • Advancing Research Community
Kate Towsey
The State of ResearchOps: More Than Just Theory
2019 • DesignOps Community
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
James Lang
Hopeful Futures for UX Research
2026 • Rosenfeld Community
Mike Oren
Design Research Strategy & Strategic Design Research
2022 • Advancing Research Community
Sheryl Cababa
Integrating Systems Thinking Into Your Practice as a Designer
2025 • Rosenfeld Community
Daniel Gloyd
Warming the User Experience: Lessons from America's first and most radical human-centered designers
2024 • Rosenfeld Community
Saara Kamppari-Miller
Inclusive Design is DesignOps
2021 • DesignOps Summit 2021
Gold
Wyatt Hayman
Global Research Panels
2020 • DesignOps Community
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold
Marc Fonteijn
First Insights from the 2025 Service Design Salary(+) Report
2024 • Advancing Service Design 2024
Gold
Nora Tejeda
Scaling Design Capabilities at BBVA Through a Self-service Design Model
2021 • Design at Scale 2021
Gold
Chelsey Glasson
Exit Interview #3: Same as It Ever Was: What Leaving Tech Taught Me About Change
2025 • Rosenfeld Community
Ana Ferreira
Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
2024 • DesignOps Summit 2020
Gold

More Videos

Sam Proulx

"Accessibility is a process, not a project."

Sam Proulx

Accessibility: An Opportunity to Innovate

November 16, 2022

Sarah Brooks

"This group has really dug in together and been discussing the talks."

Sarah Brooks

Theme 3 Intro

December 10, 2021

Louis Rosenfeld

"Sponsor sessions are free to anyone whether they’re attending this conference or not."

Louis Rosenfeld

Founder’s Welcome

December 6, 2022

Rachel Posman

"Design ops and product ops are way more alike than dissimilar; they differ mainly in the orgs they serve."

Rachel Posman John Calhoun

"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors

September 25, 2024

Abbey Smalley

"The most salary ranges fell between $140,000 to $270,000 a year, with larger companies paying more, but there’s wide variability."

Abbey Smalley

Today’s Design Ops and Programs Landscape & Career Paths

October 4, 2023

Maverick Chan

"If we invest early time building a detailed 3D model, we can endlessly capture backgrounds and test compositions."

Maverick Chan Claire Lin

From Doodle to Demo: AI as Our Storytelling Partner

October 23, 2025

Kristin Skinner

"2020 was challenging but joyful; it was a place where people could be authentic and talk about burnout and attrition."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Ruzanna Rozman

"To get into flow, I need a strong belief in the purpose and the work we’re doing."

Ruzanna Rozman

Getting in Flow with Your Team

January 8, 2024

Patrizia Bertini

"Your impact depends on strategic goals and context; without clarity, you won’t have the maximum impact."

Patrizia Bertini

DesignOps + KPIs = Measure your Impact!

January 8, 2024