Summary
"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.
Key Insights
-
•
All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.
-
•
BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.
-
•
User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.
-
•
AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.
-
•
Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.
-
•
Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.
-
•
BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.
-
•
User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.
-
•
Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.
-
•
Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.
Notable Quotes
"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."
"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."
"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."
"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."
"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."
"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."
"The only way to do research wrong is to not do it at all."
"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."
"My time is more expensive than my money; fraudulent data wastes valuable time."
"We focus on getting top quality participants and let others specialize in testing or analysis tools."
Or choose a question:
More Videos
"The power to say no has been a blessing in disguise, helping us refocus on high priority work after layoffs."
Maggie DieringerCreating Consistency Through Constant Change
January 8, 2024
"Diagramming is kindness we give to ourselves and others to get our bearings on things we’re stuck on."
Abby CovertStuck? Diagrams Help
October 27, 2022
"Impact curated by France Alana was outstanding."
Bria AlexanderDay 3 Welcome
September 25, 2024
"Pink the pink plastic glove was too big for the average woman’s hands."
Mansi GuptaDrawing from Feminist Practice to Make Inclusive Design Operational
September 9, 2022
"The only time you get to build design ops at the same time as the organization structure is like in startups, but they’re so chaotic you don’t get to enjoy it."
Dan WillisFilling the Void
November 7, 2018
"Everyone contributes to conflict; it’s not about right or wrong, but what each person is trying to protect."
Laura WeissTurn Down the Heat: 3 Ways to Handle Conflict in the Moment
November 20, 2024
"Design managers are deeply concerned about when and how their teams achieve goals while staying healthy."
Aurobinda Pradhan Shashank DeshpandeIntroduction to Collaborative DesignOps using Cubyts
September 8, 2022
"Digitizing doesn’t mean removing your frontline; frontline workers must be empowered to assist less digital citizens."
Yalenka Mariën Marie MervaillieDesigning for Digital Inclusion in the Belgian Government
December 8, 2021
"The future of civic design will be localized, designed for and by communities rather than dictated top-down."
Bria Alexander Ariel Kennan Charlotte Lee Sarah Brooks Emily Lessard Gordon Ross Joanne DongReflect and Chart Forward
December 10, 2021
Latest Books All books
Dig deeper with the Rosenbot
How does including metadata like methodology, market, and date improve the quality of research repository search results?
How many books are available in the Rosenverse Gold subscription, and in what format?
How can imperfect research still deliver valuable insights and maintain project survivability?