Redefining Toolkits: Unbundling to Create a Perfect Match
Summary
This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals:
1) Highlight some of the of tools researchers are prioritizing for their stacks
2) Present a case study of a best-in-class stack in action
Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.
Key Insights
-
•
All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.
-
•
BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.
-
•
User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.
-
•
AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.
-
•
Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.
-
•
Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.
-
•
BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.
-
•
User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.
-
•
Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.
-
•
Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.
Notable Quotes
"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."
"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."
"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."
"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."
"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."
"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."
"The only way to do research wrong is to not do it at all."
"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."
"My time is more expensive than my money; fraudulent data wastes valuable time."
"We focus on getting top quality participants and let others specialize in testing or analysis tools."
Or choose a question:
More Videos
"I was talking with a person who said I’m like an idea machine, a 24-7 idea machine. The reply was immediate. It isn’t, you get used up and spat out."
Dr. Karl JeffriesThe Science of Creativity for DesignOps
January 8, 2024
"Making your chief legal officer your best friend as a designer makes a lot of sense."
Amy MarquezINVEST: Discussion
June 15, 2018
"Enterprise UX is still nascent—businesses worldwide are just beginning to figure out where UX fits."
Steve Portigal Chris Chapo Kelly Goto Christian RohrerDiscussion
May 13, 2015
"It took a lot of relationship building and conversations to break down the perception that designers' time was owned by particular teams."
Alicia MootyDesign Staffing Models
September 30, 2021
"We may not have tech prowess but our sticky notes, card sorts, and test reports are our real superpowers."
Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt LaurenceThe Authentic UX Talent Show
January 8, 2024
"Simply asking stakeholders what success looks like for them in a project is a powerful way to start meaningful conversations."
Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne RogondinoTheme 1: Discussion
January 8, 2024
"Choosing a research repository is a big battle in your organization; the right decisions can really help you succeed."
Sofia QuinteroThe Product Philosophy Behind EnjoyHQ
March 10, 2021
"Large companies demand certainty, but certainty is the opposite of innovation."
Laura KleinUnique challenges of innovation in enterprises
April 23, 2020
"You’ve got to take control of the backlog and position your team as value-driven, not just servicing individual teams."
Andrew MichaelBuilding a Product Insights Team
March 10, 2022
