Rosenverse

Redefining Toolkits: Unbundling to Create a Perfect Match

Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Ask the Rosenbot
Chris Hodowanec
Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner
2022 • Civic Design 2022
Gold
Bill Scott
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
2015 • Enterprise UX 2015
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Alex Hurworth
Designing a Contact Tracing App for Universal Access
2020 • DesignOps Summit 2020
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Jaime Creixems
Best Practices when Creating and Maintaining a Design System
2023 • Enterprise UX 2023
Gold
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
John Cutler
Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
2024 • Advancing Service Design 2024
Gold
Janelle Estes
UX Research Trends
2021 • Advancing Research Community
Jilanna Wilson
Distributed Design Operations Management
2019 • DesignOps Summit 2019
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold
Saara Kamppari-Miller
DesignOps for Inclusive Design and Accessibility
2022 • DesignOps Community
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Lada Gorlenko
Theme 3: Introduction
2021 • Design at Scale 2021
Gold
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold

More Videos

Sahibzada Mayed

"Care can go in multiple pathways; it’s not always one-way. There’s multiplicity and duality in how care is practiced."

Sahibzada Mayed Lauren Lin

Cultivating Design Ecologies of Care, Community, and Collaboration

October 4, 2023

Frank Duran

"Setting extra places at the table is important because people will join and leave meetings depending on the project phase."

Frank Duran

Partnership Playbook: Lessons Learned in Effective Partnership

January 8, 2024

Nancy Douyon

"The nobility complex is when we in the West unintentionally create solutions without accounting for our own biases."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Onur Kocan

"Urban design competitions are declared public, but only expert architects or designers can participate."

Onur Kocan Ayhan Ensici

Understanding the Strategy for Civic Design in a Complex City: Istanbul

November 16, 2022

Rusha Sopariwala

"Show and tells are not critiques, they’re chances to share progress and practice presentation without pressure."

Rusha Sopariwala

Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+

June 9, 2022

Scott Plewes

"The SIR model is simple but can be applied beyond viruses—to information spread, finance, and UX adoption."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023

Sam Proulx

"It is very easy to tick all the accessibility checkboxes and still have a poor, ugly, and unhelpful product."

Sam Proulx

Accessibility: An Opportunity to Innovate

September 8, 2022

Michelle Bejian Lotia

"We created research indexes with search blocks that update over time to help people focus on the most recent insights."

Michelle Bejian Lotia Anne-Marie Morell

Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization

March 28, 2023

Amy Jiménez Márquez

"I really love being a manager because you get joy from seeing people grow and succeed."

Amy Jiménez Márquez Michael J. Metts Joie Chung

The Atypical UX Manager Path

July 23, 2020