Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Theme Panel

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Day 2 Theme Panel
Speakers: Megan Blocker , Amy Bucher , Katie Hansen , Ricardo Martins and Nidhi Singh Rathore
Link:

Summary

Panelists including Nadi, Amy, Katie, Ricardo, and others explored how researchers are adapting their methods to the changing dynamics between participants, researchers, and organizations. Nadi emphasized the importance of an open mind and mixed methods to uncover insights and critique tools used. Amy highlighted the need to say yes to new methods, running pilots, and staying up-to-date with emerging tools, while managing client demands. Ricardo noted that switching methods comes when existing tools can’t answer key research questions or have biases and shared inspiration from conferences. The group also discussed participatory methods, experimental designs, and the redemption of focus groups. Integrating qualitative and quantitative data and using live stories helped keep the participant experience front and center for stakeholders. Amy and others shared balancing faster, lighter studies with deeper, longer-term academic research to achieve organizational buy-in. Challenges in dealing with stakeholders who have predetermined solutions were discussed, with advice to align on shared goals and pick battles wisely to maintain research objectivity and impact. Concepts like right-sizing research (Ricardo, Nadi), systems thinking, and Lean Research principles were introduced to respect communities and strategically influence organizations. Finally, panelists recommended mentoring, community engagement, offering simple tools, and gradual experimentation to upskill researchers and colleagues new to the craft. Megan shared work on a research method playbook with a quadrant guiding new practitioners on when and how to try methods safely. The conversation underscored that research is a dynamic craft blending strategy, empathy, experimentation, and organizational navigation.

Key Insights

  • Switching to a new research method often occurs when current methods cannot adequately answer the research question or have inherent biases, as Ricardo explained.

  • A mixed-methods and cross-functional approach allows researchers to address gaps one tool alone cannot fill, advocated by Nadi.

  • Leaders like Amy encourage saying yes to team experimentation with novel tools and running pilots to evolve the research toolkit.

  • Participatory and experimental methods are gaining renewed interest, with attempts to redeem sometimes maligned methods like focus groups.

  • Combining qualitative data such as video and quotes with quantitative findings helps keep participant experiences vivid for stakeholders.

  • Right-sizing research—both in participant group size and project scope—is critical to respect community burden and project constraints, as emphasized by Ricardo and Nadi.

  • Balancing fast, lighter UX studies with longer academic or in-depth research enables continuous insight delivery and organizational patience for complexity, shared by Amy.

  • Navigating stakeholder resistance requires aligning on shared organizational goals, choosing battles carefully, and emphasizing research objectivity, as experienced by the panelists.

  • Lean Research principles focusing on respect, relevance, and appropriate scale offer frameworks for conducting equitable and community-sensitive research.

  • Upskilling less experienced researchers benefits from mentorship, community involvement, sharing simple tools and templates, and introducing safe spaces to experiment with methods.

Notable Quotes

"Tools don't matter as much as the desire to learn and ask why things keep happening the way they do."

"We say yes when teammates are curious to try new methods and run pilots to see what works and what could improve."

"When surveys measure attitude but not behavior, it's time to try methods like conjoint analysis that reduce bias."

"Focus groups have been called a curse, but I'm giving them a second chance to see if there’s something positive there."

"Combining numbers with rich participant videos and quotes really brings the user to life for stakeholders."

"Right sizing research respects communities by matching the scope to what participants can reasonably engage with."

"Slowing down research creates equitable spaces where minority and marginalized voices can be meaningfully included."

"You have to pick your battles with stakeholders—fight the ones that really matter and let smaller issues slide."

"Use systems thinking to connect insights and show how research impacts organizational strategy holistically."

"Giving someone a tool to try a method in an hour can either inspire them or clearly show it's not a fit."

Ask the Rosenbot
Dave Gray
Group Activity: Making Sense of DesignOps
2017 • DesignOps Summit 2017
Gold
Jason Mesut
Shaping design, designers and teams
2018 • DesignOps Summit 2018
Gold
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps Summit 2024
Gold
Dan Mall
“Ask Me Anything” with Dan Mall, Author of Upcoming Rosenfeld Title, Design that Scales
2023 • DesignOps Summit 2023
Gold
George Hinchliffe
Delivering Amazing Experiences
2021 • Design at Scale 2021
Gold
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Mary-Lynne Williams
Exit Interview #4: From Product Design Leadership to Sound Healing
2026 • Rosenfeld Community
Product and Design at Bloomberg: A 15-year Evolution
2022 • Design in Product 2022
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2017 • DesignOps Summit 2017
Gold
Jack Moffett
SAFe or Sorry?
2019 • Enterprise Community
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Farid Sabitov
Automatization for Large Enterprise Teams
2024 • DesignOps Summit 2020
Gold
Corey Nelson
Layoffs
2022 • Advancing Research Community
Erin Weigel
Failure Friday #6: 90% of Everything I Do is Either Broken or Pointless
2025 • Rosenfeld Community
Jane Davis
Strategic Shifts and Innovations in User Research: Navigating Challenges and Opportunities
2025 • Advancing Research 2025
Gold

More Videos

Sahibzada Mayed

"We practice care by being anti-urgency—questioning if things really need to happen when we think they do."

Sahibzada Mayed Lauren Lin

Cultivating Design Ecologies of Care, Community, and Collaboration

October 4, 2023

Frank Duran

"Engaging influencers early helped them appreciate being included sooner than later, which improved the project."

Frank Duran

Partnership Playbook: Lessons Learned in Effective Partnership

January 8, 2024

Nancy Douyon

"We all want to design for scale, but empathy alone is sometimes a shortcoming when thinking about scale."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Onur Kocan

"Urban design competitions are declared public, but only expert architects or designers can participate."

Onur Kocan Ayhan Ensici

Understanding the Strategy for Civic Design in a Complex City: Istanbul

November 16, 2022

Rusha Sopariwala

"Sticky notes and whiteboards just wouldn’t translate online, so our collaboration rituals had to change."

Rusha Sopariwala

Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+

June 9, 2022

Scott Plewes

"Math models don’t just provide numerical precision, they can be inspirational for thinking about UX spread."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023

Sam Proulx

"Accessibility requires flexible designs, not limited or simplified ones."

Sam Proulx

Accessibility: An Opportunity to Innovate

September 8, 2022

Michelle Bejian Lotia

"The feedback culture in our company means there’s transparent discussion if conclusions aren’t clear or agreed upon."

Michelle Bejian Lotia Anne-Marie Morell

Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization

March 28, 2023

Amy Jiménez Márquez

"I really love being a manager because you get joy from seeing people grow and succeed."

Amy Jiménez Márquez Michael J. Metts Joie Chung

The Atypical UX Manager Path

July 23, 2020