Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Redefining Toolkits: Unbundling to Create a Perfect Match
Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Ask the Rosenbot
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps Summit 2024
Gold
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Jeff Ephraim Bander
Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research
2022 • Advancing Research 2022
Gold
George Abraham
Design Systems To-Go: Indigo.Design Overview and Exploring the Developer Workflow (Part 3)
2021 • DesignOps Summit 2021
Gold
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Yulya Besplemennova
[Demo] Stress-testing GenAI in user research synthesis
2024 • Designing with AI 2024
Gold
Melissa Schmidt
How UX Research Hit It Big in Las Vegas
2019 • Enterprise Experience 2019
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Terry Buckman
Wargaming (An Introduction)
2023 • Enterprise Community
Theresa Marwah
How Atlassian is Operationalizing Respect in Research
2020 • Advancing Research Community
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Steve Portigal
War Stories LIVE! Steve Portigal
2020 • Advancing Research 2020
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • Rosenfeld Community
Sam Yen
Driving Organizational Change Through Design? Do more of this and less of that
2017 • Enterprise Experience 2017
Gold

More Videos

Dave Hoffer

"Donuts are delicious, right? Nobody doesn’t like donuts."

Dave Hoffer Joanne Weaver

UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer

May 21, 2025

Sam Proulx

"Artificial intelligence promises new independence for people with disabilities but raises questions of bias and privacy."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

September 9, 2022

Greg Petroff

"I know exactly this job, all its problems and dysfunctions, and I don’t want to do that anymore."

Greg Petroff

Exit Interview #1: Greg Petroff: From Silicon Valley Executive to Sonoma County Possibilitarian

September 24, 2025

Sean Dolan

"Users often re-enter the journey process after a pause, but compress previously taken steps when they come back."

Sean Dolan

A Practical Look at Creating More Usable Enterprise Customer Journeys

October 31, 2019

Allison Sanders

"Mentoring new hires actually reignites the mentor’s own passion for their work."

Allison Sanders

Operating with Purpose

January 8, 2024

Ted Neward

"We have to balance crisis management with long-term strategic exploration to not lose sight of growth."

Ted Neward

Theme 4: Enterprise Organizational Journey

June 4, 2019

Michele Wong

"Design toolkits created in design software requiring special licenses slow down personalization and adoption."

Michele Wong

Helping Them Help Us

January 8, 2024

Sam Proulx

"I don’t know anyone who uses the configuration out of the box without customizing it heavily and extensively."

Sam Proulx

Everything You Ever Wanted to Know About Screen Readers

June 11, 2021

Anna Avrekh

"Time is the only resource we cannot replenish. Make sure you don’t spend it doing what’s not meaningful."

Anna Avrekh Dr. John Pagonis Klara Pelcl Sina Schreiber

Expert Panel: Leading in and with Research

March 10, 2022