Rosenverse
Day 2 Theme Panel

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Theme Panel

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Day 2 Theme Panel
Speakers: Megan Blocker , Amy Bucher , Katie Hansen , Ricardo Martins and Nidhi Singh Rathore
Link:

Summary

Panelists including Nadi, Amy, Katie, Ricardo, and others explored how researchers are adapting their methods to the changing dynamics between participants, researchers, and organizations. Nadi emphasized the importance of an open mind and mixed methods to uncover insights and critique tools used. Amy highlighted the need to say yes to new methods, running pilots, and staying up-to-date with emerging tools, while managing client demands. Ricardo noted that switching methods comes when existing tools can’t answer key research questions or have biases and shared inspiration from conferences. The group also discussed participatory methods, experimental designs, and the redemption of focus groups. Integrating qualitative and quantitative data and using live stories helped keep the participant experience front and center for stakeholders. Amy and others shared balancing faster, lighter studies with deeper, longer-term academic research to achieve organizational buy-in. Challenges in dealing with stakeholders who have predetermined solutions were discussed, with advice to align on shared goals and pick battles wisely to maintain research objectivity and impact. Concepts like right-sizing research (Ricardo, Nadi), systems thinking, and Lean Research principles were introduced to respect communities and strategically influence organizations. Finally, panelists recommended mentoring, community engagement, offering simple tools, and gradual experimentation to upskill researchers and colleagues new to the craft. Megan shared work on a research method playbook with a quadrant guiding new practitioners on when and how to try methods safely. The conversation underscored that research is a dynamic craft blending strategy, empathy, experimentation, and organizational navigation.

Key Insights

  • Switching to a new research method often occurs when current methods cannot adequately answer the research question or have inherent biases, as Ricardo explained.

  • A mixed-methods and cross-functional approach allows researchers to address gaps one tool alone cannot fill, advocated by Nadi.

  • Leaders like Amy encourage saying yes to team experimentation with novel tools and running pilots to evolve the research toolkit.

  • Participatory and experimental methods are gaining renewed interest, with attempts to redeem sometimes maligned methods like focus groups.

  • Combining qualitative data such as video and quotes with quantitative findings helps keep participant experiences vivid for stakeholders.

  • Right-sizing research—both in participant group size and project scope—is critical to respect community burden and project constraints, as emphasized by Ricardo and Nadi.

  • Balancing fast, lighter UX studies with longer academic or in-depth research enables continuous insight delivery and organizational patience for complexity, shared by Amy.

  • Navigating stakeholder resistance requires aligning on shared organizational goals, choosing battles carefully, and emphasizing research objectivity, as experienced by the panelists.

  • Lean Research principles focusing on respect, relevance, and appropriate scale offer frameworks for conducting equitable and community-sensitive research.

  • Upskilling less experienced researchers benefits from mentorship, community involvement, sharing simple tools and templates, and introducing safe spaces to experiment with methods.

Notable Quotes

"Tools don't matter as much as the desire to learn and ask why things keep happening the way they do."

"We say yes when teammates are curious to try new methods and run pilots to see what works and what could improve."

"When surveys measure attitude but not behavior, it's time to try methods like conjoint analysis that reduce bias."

"Focus groups have been called a curse, but I'm giving them a second chance to see if there’s something positive there."

"Combining numbers with rich participant videos and quotes really brings the user to life for stakeholders."

"Right sizing research respects communities by matching the scope to what participants can reasonably engage with."

"Slowing down research creates equitable spaces where minority and marginalized voices can be meaningfully included."

"You have to pick your battles with stakeholders—fight the ones that really matter and let smaller issues slide."

"Use systems thinking to connect insights and show how research impacts organizational strategy holistically."

"Giving someone a tool to try a method in an hour can either inspire them or clearly show it's not a fit."

Ask the Rosenbot
Erin Weigel
UX Lessons from running more than 1,200 A/B Tests
2024 • Rosenfeld Community
Victor Udoewa
Research in the Pluriverse
2023 • Advancing Research 2023
Gold
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps Summit 2024
Gold
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Jodi Forlizzi
Design and AI innovation
2024 • Designing with AI 2024
Gold
Rachel Posman
"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors
2024 • DesignOps Summit 2024
Gold
Caroline Jarrett
Garbage in, garbage out? Measuring error rates to get ready for AI
2026 • Rosenfeld Community
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Bria Alexander
Day 1 Panel: Up to the Minute: The latest in AI’s impact on UX
2025 • Designing with AI 2025
Gold
Dean Broadley
Not Black Enough to be White
2024 • DesignOps Summit 2020
Gold
Kritika Yadav
Optimizing AI Conversations: A Case Study on Personalized Shopping Assistance Frameworks
2025 • Designing with AI 2025
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Erin Weigel
Get Your Whole Team Testing to Design for Impact
2024 • Rosenfeld Community
Elizabeth Sklar
Co-creating research enablement with your tech org: a case study
2026 • Advancing Research 2026
Gold
Louis Rosenfeld
Becoming a Civic Designer: Making the Move from Private to Public Sector
2022 • Civic Design 2022
Gold
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold

More Videos

Edward Cupps

"I was no longer a point person in recruiting or shaping the team, but that was okay."

Edward Cupps

The Principal Path: Journeying from Management to Individual Contributor

June 11, 2021

Heidi Trost

"Onboarding is often fleeting, so influencing security behavior there has an outsized impact."

Heidi Trost

To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity

January 23, 2025

Emily Danielson

"Our design skills can help to create Clarity in times of Chaos."

Emily Danielson

“I mean, I can lift a shovel”: Design Skills in Disaster Response

June 9, 2022

Sofía Delsordo

"The Ministry of Culture will be the only government office totally open for public use."

Sofía Delsordo Kassim Vera

Public Policy for Jalisco's Designers to Make Design Matter

December 8, 2021

Susan Simon-Daniels

"As a researcher, your brain is shouting, red alert, red alert, there’s some problem I need to find out."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Kara Kane

"Scaling training happened by finding people in the community who could run sessions independently."

Kara Kane

Communities of Practice for Civic Design

April 7, 2022

Paz Perez

"More context is not going to make a better product; everything you put in the context competes for attention."

Paz Perez

Context Architecture for AI systems

September 11, 2026

Darian Davis

"A common toxic behavior is glory seeking, like presenting work as your own when it was a team effort."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Nora Tejeda

"We use Stacy’s matrix and James Garrett’s layers of user experience to filter which projects go into the self-service model."

Nora Tejeda Giovanna Alonso

Scaling Design Capabilities at BBVA Through a Self-service Design Model

June 10, 2021