Rosenverse

Redefining Toolkits: Unbundling to Create a Perfect Match

Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Ask the Rosenbot
Craig Villamor
Resilient Enterprise Design
2017 • Enterprise Experience 2017
Gold
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Gillian Salerno-Rebic
From Insight to Impact: How JourneySpark Used WEVO Pulse + Pro to Drive a 50% Lift in Ad Engagement
2025 • Designing with AI 2025
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • DesignOps Summit 2025
Gold
Jemma Ahmed
Research at an inflection point: Adapting to a new era of collaboration, equity, and innovation
2025 • Advancing Research 2025
Gold
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Saara Kamppari-Miller
Cartography for Design Communities
2025 • DesignOps Summit 2025
Gold
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
Laura Klein
Human vs. machine: Testing AI’s ability to synthesize and analyze research
2026 • Advancing Research 2026
Gold
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Stefanie Owens
Optimizing for Outcomes: Transformation Design in Systems at Scale
2024 • Advancing Service Design 2024
Gold
Theresa Slate
Why Changing Hearts & Minds Doesn’t Work When Promoting DE&I Efforts, but Checklists Do
2023 • DesignOps Summit 2023
Gold
Corey Long
Hiring in DesignOps: A Critical Study on How to Hire and Get Hired
2024 • DesignOps Summit 2024
Gold
Harry Brignull
Beyond Clicks and Tricks: Why deceptive design has grown into a regulatory faultline
2026 • Rosenfeld Community
Iain McMaster
Design and Product: from Frenemy to Harmony
2023 • Design in Product 2023
Gold

More Videos

Daniel Gloyd

"The epidemic of isolation is tied to digital design that creates connectivity without connection."

Daniel Gloyd

Designing Warmth

February 26, 2025

David Sternberg

"User intent exists in a probabilistic superposition of multiple possible actions until a choice is made."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025

Karen McGrane

"The real value of AI in IA is as a collaborative tool requiring significant human support, not a magic knob to turn."

Karen McGrane Jeff Eaton

AI for Information Architects: Are the robots coming for our jobs?

November 21, 2024

John Cutler

"Everyone is circling around similar topics but in very different ways—there’s a battle of models but more similarities than differences."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Erin Hoffman-John

"Being delightful is the only thing that a video game does. It has no other purpose."

Erin Hoffman-John

This Game is Never Done: Design Leadership Techniques from the Video Game World

November 6, 2017

Matt Duignan

"Every claim and recommendation inside HITS has its own URL so partners can share and track knowledge."

Matt Duignan

HITS, Microsoft's internal human insight system: From research library to living body of knowledge

July 16, 2019

Peter Merholz

"Elevation of design leadership to no more than two levels below the CEO signals that design is important company-wide."

Peter Merholz

Design at Scale is People!

June 11, 2021

Davis Neable

"Investing time in people, relationships, and collaboration pays off in stronger teams and better user experiences."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Catt Small

"Visions capture held knowledge that a team has maybe not been able to yet take action on."

Catt Small

Craft a Vision that Actually Gets Shipped

April 30, 2026