Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Interviews remain central but should be complemented with other methods for richer insights.

  • Quantitative techniques like conjoint analysis reveal patterns that interviews alone may miss.

  • Transitioning from structured experiments to interviews often feels uncomfortable but offers new exploration modes.

  • Observational methods such as contextual inquiry uncover users' tacit behaviors and workarounds.

  • Participant comfort and rapport especially matter when dealing with sensitive or high-stakes topics.

  • Mixed methods research benefits from collaboration across different roles, including data analysts and community organizations.

  • Researchers should be pragmatic about time and resources and pick methods fit for purpose and confidence needs.

  • Interviews are often misused as an easy default instead of creatively finding better alternatives.

  • Decentering the researcher and involving community partners leads to more inclusive and authentic data.

  • Researchers must check their own unconscious biases to avoid misinterpreting participant responses.

Notable Quotes

"User interviews are an absolute mainstay of user research practices and likely will always be a core tool."

"Some people lie; that’s why we need to triangulate methods to approach reality."

"Interviews can be a crutch that keeps us from using better ways to answer our questions."

"Allow space for participants to demonstrate expertise before digging deeper in interviews."

"It’s important to put the participant at ease and not add to their cognitive burden."

"People generally want to help and tell what they genuinely believe; they’re just terrible at accurate recall."

"Creativity is needed right from the research stage, not just in solution design."

"The purpose of research is paramount; it guides the choice of methods and how rigorously to apply them."

"If you don’t have researchers to shadow, lean on communities, data scientists, or industry organizations."

"Asking for help and humbling yourself is one of the most powerful ways to grow as a researcher."

Ask the Rosenbot
Dave Gray
Liminal Thinking: Sense-making for systems in large organizations
2015 • Enterprise UX 2015
Gold
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Jacqui Frey
Flow and Superfluidity for Design Orgs
2018 • DesignOps Summit 2018
Gold
Reginé Gilbert
Asking the Right Questions: Life, Hope and Moving Forward During the Pandemic
2022 • Design at Scale 2022
Gold
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Scher Foord
Turn the Ship Around: How to Apply Design Thinking Across Your Organization
2021 • Design at Scale 2021
Gold
Laurent Christoph
Scale the impact of DesignOps in 3D: Diligence, Decision, Discipline
2025 • DesignOps Community
Deirdre Hirschtritt
Research is Only as Good as the Relationships You Build
2022 • Civic Design 2022
Gold
Dan Willis
Enterprise Storytelling Sessions
2018 • Enterprise Experience 2018
Gold
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold
Nathan Curtis
Beyond the Toolkit: Spreading a System Across People & Products
2016 • Enterprise UX 2016
Gold
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization
2020 • Enterprise Community
Janaki Kumar
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold

More Videos

Jackie Ajoux

"Assume you already have a seat at the table."

Jackie Ajoux

Leveling-Up: A Single-Player’s Guide to the DesignOps Team-of-One

January 8, 2024

Marjorie Stainback

"Our program changed trains people to create high quality, unbiased user research."

Marjorie Stainback Kelsey Kingman

Transforming Strategic Research Capacity through Democratization

October 24, 2019

Shazia Ali

"If you take the audience on the journey right from the beginning, it becomes more of a conversation."

Shazia Ali Bruce Gillespie Joyce Lee Andy Warr

Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]

August 21, 2024

Alla Weinberg

"The quickest way I found to create connection is through the Enneagram personality assessment."

Alla Weinberg

Cross-Functional Relationship Design

December 6, 2022

Kristen Guth, Ph.D.

"Most product decisions look intuitive, but intuition alone leads to coherent stories that can be wrong."

Kristen Guth, Ph.D.

Out of the FOG: A Non-traditional Research Approach to Alignment

March 28, 2023

Zariah Cameron

"Hiring a DEI team and then completely letting them go after less than two years is performative, not intentional."

Zariah Cameron

Streamlining an Inclusive Design Practice

October 3, 2023

Joshua Graves

"Language is imprecise; banning crutch words like MVP forces people to clarify real meaning."

Joshua Graves

We Need To Talk: Managing Ludicrous Requests at Work (Part 3 of 3)

May 12, 2025

Aras Bilgen

"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."

Aras Bilgen

Who does the math: A designer’s journey in building an AI-based tutoring app

June 10, 2025

Kathleen Asjes

"If you have to choose between doing bad research or no research at all, you’re better off not doing it — Lisa Reichelt."

Kathleen Asjes

Research Democratization: the Good, the Bad and the Ugly

March 10, 2022