Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Redefining Toolkits: Unbundling to Create a Perfect Match
Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
John Calhoun
Have we Reached Our Peak? Spotting the Next Mountain For DesignOps to Climb
2021 • DesignOps Summit 2021
Gold
Dalia El-Shimy
So You've Got a Seat at the Table. Now What?
2020 • Advancing Research 2020
Gold
Gillian Salerno-Rebic
Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation
2025 • Designing with AI 2025
Conference
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Melissa Tsang
From Insights to Action: Driving Business Values through DesignOps
2024 • DesignOps Summit 2020
Gold
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Conference
George Aye
That Quiet Little Voice: When Design and Ethics Collide
2022 • Civic Design 2022
Gold
Molly Fargotstein
Multipurpose Communication & UX Research Marketing
2019 • DesignOps Community
Maggie Dieringer
Cutting through the Noise
2020 • DesignOps Community
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Leisa Reichelt
The Five Dysfunctions of Democratized Research at Scale
2020 • Advancing Research 2020
Gold
Elana Chapman
Getting started with accessibility research
2025 • Rosenfeld Community

More Videos

JP Allen

"Zoom has a feature that lets you share controls so participants can click through prototypes live during a session."

JP Allen Carrie Boyd Malcolm Evans

Navigating the UX Tool Landscape

March 11, 2021

Paula Bach

"Collecting habit path data in every study over time builds a data set that informs product decisions."

Paula Bach

Improving Legacy Software: How Much Better Does it Have to Be?

March 11, 2022

Simon Wardley

"The Red Queen effect means you have no choice but to adapt as others evolve faster."

Simon Wardley

Maps and Topographical Intelligence

January 31, 2019

Nick Cochran

"Sense making is a motivated continuous effort to understand connections and act effectively."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 20, 2019

Nick Cochran

"Inviting people outside your silo to join projects can lead to better outcomes and personal growth."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 3, 2019

Sarah Fathallah

"Ethical judgment is the ability to maximize benefits while minimizing harm to the communities we work with."

Sarah Fathallah Alba Villamil

Beyond insights: Rethinking the role of researchers as stewards of organizational wisdom

March 13, 2025

Chris Hammond

"Efficiency in design and delivery reduces energy use and thus contributes directly to sustainability gains."

Chris Hammond

Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"

April 2, 2025

Christian Crumlish

"Product manager is not the CEO of the product and I don’t think that’s a very helpful metaphor."

Christian Crumlish

AMA with Christian Crumlish, author of Product Management for UX People

March 24, 2022

Dave Hoffer

"People eat with their eyes before they eat with their mouths — your portfolio must look appealing."

Dave Hoffer Joanne Weaver

UX Job Search AMA #3 with Joanne Weaver and Dave Hoffer

July 16, 2025