Rosenverse
Day 2 Theme Panel

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Theme Panel

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Day 2 Theme Panel
Speakers: Megan Blocker , Amy Bucher , Katie Hansen , Ricardo Martins and Nidhi Singh Rathore
Link:

Summary

Panelists including Nadi, Amy, Katie, Ricardo, and others explored how researchers are adapting their methods to the changing dynamics between participants, researchers, and organizations. Nadi emphasized the importance of an open mind and mixed methods to uncover insights and critique tools used. Amy highlighted the need to say yes to new methods, running pilots, and staying up-to-date with emerging tools, while managing client demands. Ricardo noted that switching methods comes when existing tools can’t answer key research questions or have biases and shared inspiration from conferences. The group also discussed participatory methods, experimental designs, and the redemption of focus groups. Integrating qualitative and quantitative data and using live stories helped keep the participant experience front and center for stakeholders. Amy and others shared balancing faster, lighter studies with deeper, longer-term academic research to achieve organizational buy-in. Challenges in dealing with stakeholders who have predetermined solutions were discussed, with advice to align on shared goals and pick battles wisely to maintain research objectivity and impact. Concepts like right-sizing research (Ricardo, Nadi), systems thinking, and Lean Research principles were introduced to respect communities and strategically influence organizations. Finally, panelists recommended mentoring, community engagement, offering simple tools, and gradual experimentation to upskill researchers and colleagues new to the craft. Megan shared work on a research method playbook with a quadrant guiding new practitioners on when and how to try methods safely. The conversation underscored that research is a dynamic craft blending strategy, empathy, experimentation, and organizational navigation.

Key Insights

  • •

    Switching to a new research method often occurs when current methods cannot adequately answer the research question or have inherent biases, as Ricardo explained.

  • •

    A mixed-methods and cross-functional approach allows researchers to address gaps one tool alone cannot fill, advocated by Nadi.

  • •

    Leaders like Amy encourage saying yes to team experimentation with novel tools and running pilots to evolve the research toolkit.

  • •

    Participatory and experimental methods are gaining renewed interest, with attempts to redeem sometimes maligned methods like focus groups.

  • •

    Combining qualitative data such as video and quotes with quantitative findings helps keep participant experiences vivid for stakeholders.

  • •

    Right-sizing research—both in participant group size and project scope—is critical to respect community burden and project constraints, as emphasized by Ricardo and Nadi.

  • •

    Balancing fast, lighter UX studies with longer academic or in-depth research enables continuous insight delivery and organizational patience for complexity, shared by Amy.

  • •

    Navigating stakeholder resistance requires aligning on shared organizational goals, choosing battles carefully, and emphasizing research objectivity, as experienced by the panelists.

  • •

    Lean Research principles focusing on respect, relevance, and appropriate scale offer frameworks for conducting equitable and community-sensitive research.

  • •

    Upskilling less experienced researchers benefits from mentorship, community involvement, sharing simple tools and templates, and introducing safe spaces to experiment with methods.

Notable Quotes

"Tools don't matter as much as the desire to learn and ask why things keep happening the way they do."

"We say yes when teammates are curious to try new methods and run pilots to see what works and what could improve."

"When surveys measure attitude but not behavior, it's time to try methods like conjoint analysis that reduce bias."

"Focus groups have been called a curse, but I'm giving them a second chance to see if there’s something positive there."

"Combining numbers with rich participant videos and quotes really brings the user to life for stakeholders."

"Right sizing research respects communities by matching the scope to what participants can reasonably engage with."

"Slowing down research creates equitable spaces where minority and marginalized voices can be meaningfully included."

"You have to pick your battles with stakeholders—fight the ones that really matter and let smaller issues slide."

"Use systems thinking to connect insights and show how research impacts organizational strategy holistically."

"Giving someone a tool to try a method in an hour can either inspire them or clearly show it's not a fit."

Ask the Rosenbot
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Feyikemi Akinwolemiwa
Play to innovate: How curiosity and experimentation transform UX
2026 • Advancing Research 2026
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps Summit 2024
Gold
Sara Logel
Your Colleagues are Your Users Too
2023 • Advancing Research 2023
Gold
Wendy Johansson
Design at Scale: Behind the Scenes
2021 • Enterprise Community
James Lang
Hopeful Futures for UX Research
2026 • Rosenfeld Community
Benjamin Real
Maturity Models: A Core Tool for Creating a DesignOps Strategy
2021 • DesignOps Summit 2021
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Landon Barnes
Are My Research Findings Actually Meaningful?
2022 • Advancing Research 2022
Gold
Magdalena Zadara
Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
2022 • Civic Design 2022
Gold
David Siren Eisner
From prototype to production: Vibe coding design for real engineering systems
2026 • Designing with AI 2026
Gold
Kim Lenox
Leading Distributed Global Teams
2019 • Enterprise Community
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Feyikemi Akinwolemiwa
Uninvited, Not Unwelcome: What Researchers Bring When Nobody Asked
2026 • Rosenfeld Community
Neil Barrie
Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
2024 • Advancing Research 2024
Gold

More Videos

George Aye

"A social contract is what we expect of each other when we're in need."

George Aye

Designing a New Social Contract

June 25, 2026

Tina Weisser

"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."

Tina Weisser

When AI Agents Meet Reality. Service Design Lessons from a Pilot

February 26, 2026

Erin Malone

"Learning the fundamentals will be like learning the classics. You learn them once but may not use them every day."

Erin Malone

Understanding the past to prepare for the future

July 19, 2024

Jack Moffett

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

Jack Moffett

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

September 22, 2022

Alison Rand

"Qualitative data is data. It’s okay to be informal and human when designing complex systems."

Alison Rand Sarah Brooks

Scaling Impact with Service Design

March 25, 2021

Sam Proulx

"Reddit recently fixed their upvote button so it announces toggle states, something many sites neglect."

Sam Proulx

Everything You Ever Wanted to Know About Screen Readers

June 11, 2021

Nicole Aleong

"Expectation describes how things ought to be and reinforces the distinction between the present and what is not yet here."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Irina Tikhonova

"People just wanted to get in, get what they needed, and get out without figuring out government operations."

Irina Tikhonova Kari Dietrich

Small Wins, Big Impact: Leveraging and Elevating User Engagement

December 9, 2021

Feyikemi Akinwolemiwa

"There’s no way everyone else can see what we’re capable of doing if we don’t step out from our defined areas."

Feyikemi Akinwolemiwa

Uninvited, Not Unwelcome: What Researchers Bring When Nobody Asked

August 19, 2026

Latest Books All books