Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Redefining Toolkits: Unbundling to Create a Perfect Match
Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Sam Yen
Driving Organizational Change Through Design? Do more of this and less of that
2017 • Enterprise Experience 2017
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Dr. Jamika D. Burge
A Genuine Conversation about the Future of UX Research
2024 • Advancing Research Community
John Taschek
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Crystal Philcox
The Many Faces of Operations
2017 • DesignOps Summit 2017
Gold
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Erik Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Feleesha Sterling
Building a Rapid Research Program
2023 • Enterprise Community
Tricia Wang
Spatial Collapse: Designing for Emergent Culture
2024 • Enterprise Experience 2020
Gold
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold
Vicky Teinaki
Short Take #3: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire
2022 • Civic Design Community

More Videos

Spencer L. A. Stultz

"Dominant culture is not some natural default setting, it’s culture that imposes itself onto a space or group of people."

Spencer L. A. Stultz

Why Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives

October 4, 2023

Jules Monza

"When product teams proactively engage you early, instead of last minute, that’s a huge cultural shift indicating maturity."

Jules Monza

Use These Words and Count These Things

September 25, 2024

Matt Bernius

"True consent means forms and processes designed for human understanding, not just organizational legal protection."

Matt Bernius Rachael Dietkus, LCSW Aditi Joshi Alba Villamil

Learnings from Applying Trauma-Informed Principles to the Research Process

March 10, 2022

George Hinchliffe

"Collaboration during COVID was successful using tools like Miro to do remote whiteboarding and brainstorming across time zones."

George Hinchliffe Joy Liu

Delivering Amazing Experiences

June 10, 2021

Jemma Ahmed

"Jackie Ho talks about how to keep teams accountable and aligned while maintaining their autonomy."

Jemma Ahmed

Theme 2 Intro

January 8, 2024

Brad Peters

"Having a well-thought-out data package really helps us see a fuller picture."

Brad Peters Anne Mamaghani

Short Take #1: UX/Product Lessons from Your Industry Peers

December 6, 2022

Alex Hurworth

"Resilience is built through community engagement and innovative thinking."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Jodi Forlizzi

"When you put a worker at the center and empower them in data collection and product design, the outcome benefits the worker."

Jodi Forlizzi

Design and AI innovation

June 5, 2024

Scher Foord

"Trust is hard to find but essential; we hire smart people so let’s all trust and move forward."

Scher Foord Corey Greenltch Sarah Rowe

Turn the Ship Around: How to Apply Design Thinking Across Your Organization

June 10, 2021