Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Theme Panel
Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Day 2 Theme Panel
Speakers: Megan Blocker , Amy Bucher , Katie Hansen , Ricardo Martins and Nidhi Singh Rathore
Link:

Summary

Panelists including Nadi, Amy, Katie, Ricardo, and others explored how researchers are adapting their methods to the changing dynamics between participants, researchers, and organizations. Nadi emphasized the importance of an open mind and mixed methods to uncover insights and critique tools used. Amy highlighted the need to say yes to new methods, running pilots, and staying up-to-date with emerging tools, while managing client demands. Ricardo noted that switching methods comes when existing tools can’t answer key research questions or have biases and shared inspiration from conferences. The group also discussed participatory methods, experimental designs, and the redemption of focus groups. Integrating qualitative and quantitative data and using live stories helped keep the participant experience front and center for stakeholders. Amy and others shared balancing faster, lighter studies with deeper, longer-term academic research to achieve organizational buy-in. Challenges in dealing with stakeholders who have predetermined solutions were discussed, with advice to align on shared goals and pick battles wisely to maintain research objectivity and impact. Concepts like right-sizing research (Ricardo, Nadi), systems thinking, and Lean Research principles were introduced to respect communities and strategically influence organizations. Finally, panelists recommended mentoring, community engagement, offering simple tools, and gradual experimentation to upskill researchers and colleagues new to the craft. Megan shared work on a research method playbook with a quadrant guiding new practitioners on when and how to try methods safely. The conversation underscored that research is a dynamic craft blending strategy, empathy, experimentation, and organizational navigation.

Key Insights

  • Switching to a new research method often occurs when current methods cannot adequately answer the research question or have inherent biases, as Ricardo explained.

  • A mixed-methods and cross-functional approach allows researchers to address gaps one tool alone cannot fill, advocated by Nadi.

  • Leaders like Amy encourage saying yes to team experimentation with novel tools and running pilots to evolve the research toolkit.

  • Participatory and experimental methods are gaining renewed interest, with attempts to redeem sometimes maligned methods like focus groups.

  • Combining qualitative data such as video and quotes with quantitative findings helps keep participant experiences vivid for stakeholders.

  • Right-sizing research—both in participant group size and project scope—is critical to respect community burden and project constraints, as emphasized by Ricardo and Nadi.

  • Balancing fast, lighter UX studies with longer academic or in-depth research enables continuous insight delivery and organizational patience for complexity, shared by Amy.

  • Navigating stakeholder resistance requires aligning on shared organizational goals, choosing battles carefully, and emphasizing research objectivity, as experienced by the panelists.

  • Lean Research principles focusing on respect, relevance, and appropriate scale offer frameworks for conducting equitable and community-sensitive research.

  • Upskilling less experienced researchers benefits from mentorship, community involvement, sharing simple tools and templates, and introducing safe spaces to experiment with methods.

Notable Quotes

"Tools don't matter as much as the desire to learn and ask why things keep happening the way they do."

"We say yes when teammates are curious to try new methods and run pilots to see what works and what could improve."

"When surveys measure attitude but not behavior, it's time to try methods like conjoint analysis that reduce bias."

"Focus groups have been called a curse, but I'm giving them a second chance to see if there’s something positive there."

"Combining numbers with rich participant videos and quotes really brings the user to life for stakeholders."

"Right sizing research respects communities by matching the scope to what participants can reasonably engage with."

"Slowing down research creates equitable spaces where minority and marginalized voices can be meaningfully included."

"You have to pick your battles with stakeholders—fight the ones that really matter and let smaller issues slide."

"Use systems thinking to connect insights and show how research impacts organizational strategy holistically."

"Giving someone a tool to try a method in an hour can either inspire them or clearly show it's not a fit."

Ask the Rosenbot
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold
Noz Urbina
Rapid AI-powered UX (RAUX): A framework for empowering human designers
2025 • Rosenfeld Community
Benjamin Real
Maturity Models: A Core Tool for Creating a DesignOps Strategy
2021 • DesignOps Summit 2021
Gold
John Maeda
About Design Organizations
2019 • DesignOps Community
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Dr. Jamika D. Burge
A Genuine Conversation about the Future of UX Research
2024 • Advancing Research Community
Cassandra Piester
Developing and Deploying Your Design Operations Strategy
2024 • DesignOps Summit 2024
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • Rosenfeld Community
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group
Iram Shah
Closing Keynote: The View from the Top
2019 • Enterprise Experience 2019
Gold
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 1: The new product journey
2025 • Rosenfeld Community
Jake Burghardt
Stop wasting research: Create new value with insight summaries
2025 • Rosenfeld Community
Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold

More Videos

Boon Yew Chew

"Designing for equity means bringing voices of those not in the room back into the system we design."

Boon Yew Chew

Making Sense of Systems—and Using Systems to Make Sense of the Enterprise

June 6, 2023

Landon Barnes

"Meaningfulness is linked directly to what your organization cares about in terms of goals and priorities."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Patrizia Bertini

"It’s less about processes and more about the business value of design."

Patrizia Bertini Alexandra Mengoni León

Pushing DesignOps’ Influence into New Global Markets

September 9, 2022

Jacqui Frey

"Design Ops brings the joy back into design."

Jacqui Frey

Scale is Social Work

March 19, 2020

Robert Schwartz

"This is us. This is all of us in this room. That could be your mom or your son or your daughter or you that have been through that."

Robert Schwartz

We're Here for the Humans

June 9, 2017

Tamara Hale

"It’s probably a good idea to remove the piercings my interpreter confirmed."

Tamara Hale

War Stories LIVE! Tamara Hale

March 30, 2020

Zariah Cameron

"If you are silent about your pain, they will kill you and say you enjoyed it."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Dave Hoffer

"People eat with their eyes before they eat with their mouths — your portfolio must look appealing."

Dave Hoffer Joanne Weaver

UX Job Search AMA #3 with Joanne Weaver and Dave Hoffer

July 16, 2025

Feleesha Sterling

"The advantage of having one moderator is I work with all the teams pretty much and can connect the dots across products."

Feleesha Sterling

Building a Rapid Research Program

May 18, 2023