Rosenverse

Redefining Toolkits: Unbundling to Create a Perfect Match

Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match.
This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals:

1) Highlight some of the of tools researchers are prioritizing for their stacks
2) Present a case study of a best-in-class stack in action

Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • •

    All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • •

    BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • •

    User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • •

    AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • •

    Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • •

    Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • •

    BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • •

    User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • •

    Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • •

    Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Ask the Rosenbot
Carla Casariego
DesignOps in Wonderland
2019 • DesignOps Summit 2019
Gold
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Ovetta Sampson
Managing the Human Engagement Risks of AI
2025 • Designing with AI 2025
Gold
John Paul de Guzman
10k Screens Later: How We Became a Data-Driven Design Organization
2024 • DesignOps Summit 2024
Gold
Louis Rosenfeld
Opening Remarks
2022 • Civic Design 2022
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Cennydd Bowles
Exit Interview #2: Rediscovering the ethical heart of design
2025 • Rosenfeld Community
Raven Veal
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
2021 • Advancing Research 2021
Gold
Alla Weinberg
People Are Sick of Change: Psychological Safety is the Cure
2023 • DesignOps Community
Lada Gorlenko
Theme 2 Intro
2022 • Design at Scale 2022
Gold
Cheryl Platz
Embrace Your Fun Factor: Game Development Best Practices for Product Design
2026 • Rosenfeld Community
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Daniel J. Rosenberg
Digital Medicine Design
2019 • Enterprise Community
Anne Mamaghani
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
2023 • Advancing Research 2023
Gold
Amy Parness
Scaling Sustainability: Complementary strategies that drive long-term success
2025 • Climate UX Interest Group
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Advancing Research Community

More Videos

Matt Webb

"Mini apps might not be useful for you, but they are for someone, and now those people can have them."

Matt Webb

Context Window: Five Futures for AI

June 11, 2025

Sofia Quintero

"Most teams want to build for 50, 100 people and migrate years of data instead of starting small."

Sofia Quintero

Beyond Tools: The Messy Business of Implementing Research Repositories

March 10, 2022

Mansi Gupta

"Women are more likely to die in car crashes because crash test dummies are not designed with women in mind."

Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices

September 15, 2022

Matteo Gratton

"As designers, we decide what data is required and what data is shared, and that brings responsibility."

Matteo Gratton

Can Data and Ethics Live Together?

October 1, 2021

Tara Tressel

"Having one-on-calls with people is one of my favorite parts of conducting research, and it felt like this was being taken away from me just for the sake of saving business resources."

Tara Tressel

Investigating qualitative depth of AI-moderated interviews

March 10, 2026

Louis Rosenfeld

"Talking about climate openly, even if uncomfortable, is a powerful way to create change."

Louis Rosenfeld Matt Jones Olga Khroustaleva Michael Leggett Karol Munoz

Do you want to work on climate? (Climate UX Discussion Series)

November 15, 2023

David Cronin

"We found that different failure modes of equipment have different spatial signatures on spider web charts."

David Cronin

The GE Design System and Thoughts about Craft at Scale

May 13, 2015

Laureen Kattan

"Healthcare IT is a highly regulated industry with a lack of standardization and many legacy systems."

Laureen Kattan Julie Kim

Centering Patients and Clinicians in a Complex Government Ecosystem

November 29, 2023

Michael Weir

"Once you find a behavioral experiment that works, it’s like playing Minesweeper—you place bets based on current knowledge to uncover more."

Michael Weir

Mixed Methods and Behavioural Science

May 26, 2023

Latest Books All books