Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Interviews remain central but should be complemented with other methods for richer insights.

  • Quantitative techniques like conjoint analysis reveal patterns that interviews alone may miss.

  • Transitioning from structured experiments to interviews often feels uncomfortable but offers new exploration modes.

  • Observational methods such as contextual inquiry uncover users' tacit behaviors and workarounds.

  • Participant comfort and rapport especially matter when dealing with sensitive or high-stakes topics.

  • Mixed methods research benefits from collaboration across different roles, including data analysts and community organizations.

  • Researchers should be pragmatic about time and resources and pick methods fit for purpose and confidence needs.

  • Interviews are often misused as an easy default instead of creatively finding better alternatives.

  • Decentering the researcher and involving community partners leads to more inclusive and authentic data.

  • Researchers must check their own unconscious biases to avoid misinterpreting participant responses.

Notable Quotes

"User interviews are an absolute mainstay of user research practices and likely will always be a core tool."

"Some people lie; that’s why we need to triangulate methods to approach reality."

"Interviews can be a crutch that keeps us from using better ways to answer our questions."

"Allow space for participants to demonstrate expertise before digging deeper in interviews."

"It’s important to put the participant at ease and not add to their cognitive burden."

"People generally want to help and tell what they genuinely believe; they’re just terrible at accurate recall."

"Creativity is needed right from the research stage, not just in solution design."

"The purpose of research is paramount; it guides the choice of methods and how rigorously to apply them."

"If you don’t have researchers to shadow, lean on communities, data scientists, or industry organizations."

"Asking for help and humbling yourself is one of the most powerful ways to grow as a researcher."

Ask the Rosenbot
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Kara Kane
Theme One Intro
2022 • Civic Design 2022
Gold
Dave Hora
Research in the Face of Complexity: New Sensibility for New Situations
2025 • Rosenfeld Community
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Liz Ebengo
The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward
2024 • Advancing Service Design 2024
Gold
Katie Johnson
Disrupting generative AI products with just-in-time consumer insights
2024 • Designing with AI 2024
Gold
Kristin Skinner
Five Years of DesignOps
2021 • DesignOps Summit 2021
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
John Donmoyer
Shipping your code generation experiments to production
2025 • Designing with AI 2025
Gold
Sarah Williams
A Framework for CX Transformation
2021 • Design at Scale 2021
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Gonzalo Goyanes
Design ROI: Cover a Little, Get a Lot
2022 • DesignOps Summit 2022
Gold
Ruzanna Rozman
Getting in Flow with Your Team
2024 • DesignOps Summit 2020
Gold
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series]
2023 • Advancing Research Community

More Videos

Christian Bason

"We can prototype policies by imagining a citizen’s daily life if a policy is realized, despite political and time constraints."

Christian Bason

Innovating With People: Unleashing the Potential of Civic Design

December 8, 2021

Shazia Ali

"Often we intend to be a host, but act more like a butler by backing away during the conversation."

Shazia Ali Bruce Gillespie Joyce Lee Andy Warr

Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]

August 21, 2024

Nick Cochran

"Don’t make the spotlight about yourself; give it back to the people doing great work in your organization."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 3, 2019

Jim Kalbach

"That unit there is kind of like a sprint."

Jim Kalbach

Jazz Improvisation as a Model for Team Collaboration

June 4, 2019

Joseph Meersman

"An ad hoc critique is best when guard is down, it’s quick, time-sensitive, and helps share early to avoid costly late feedback."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Dan Ward

"They studied their failures, faced them directly, and used those learnings to shape the next experiment."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Clara Kliman-Silver

"It can be really hard to tell what is AI and what isn’t, and your average user may not know the difference."

Clara Kliman-Silver

UX Futures: The Role of Artificial Intelligence in Design

June 7, 2023

Patrick Boehler

"Small specific interventions travel further than big programs within organizations."

Patrick Boehler Madison Karas

The service shift: transforming media organizations to create real value through design

November 19, 2025

Deanna Smith

"We forget a lot of details over time; documentation saves us from repeating mistakes."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024