Summary
Explore the evolving world of participant recruitment and management tools at the UXR Tools Summit. Kate Towsey, author of Research That Scales and founder of the Cha Cha Club, will host leaders from UserTesting and RallyUXR who will outline their vision for connecting researchers with the right participants faster and more ethically. They’ll showcase innovative features that streamline screening, scheduling, and incentive management, and invite attendees into thoughtful discussion. Ideal for UX, design, and market researchers focused on improving research quality through smarter participant engagement and operational efficiency.
Key Insights
-
•
User Interviews focuses heavily on matching algorithms and fraud detection, using AI and LLMs to improve participant quality and reduce fraudulent activity.
-
•
AI is increasing demand for user research but also pressures research teams to move faster to keep up with rapid software development cycles.
-
•
Research infrastructure platforms like Rally provide a scalable participant CRM integrated deeply with organizations’ existing systems (Salesforce, Snowflake) and enable self-serve participant filtering through AI.
-
•
Democratization of user research means many stakeholders outside traditional research roles are conducting user interviews, increasing the risk of poor participant quality and research decisions.
-
•
The acquisition of User Interviews by UserTesting aims to unify participant networks and provide seamless experiences without losing tool integrations or openness.
-
•
Synthetic users or virtual personas are being explored mainly for training and early prototype testing, but real human participants remain essential for unique insights.
-
•
Research operations roles are shifting towards orchestrating broader data and AI-driven insights, not just conducting primary research.
-
•
Security and privacy remain critical concerns in leveraging AI with participant data, and strict governance and consent tracking are necessary.
-
•
Pacing in research is a key challenge: balancing fast delivery with quality insights requires thoughtful integration of AI and infrastructure.
-
•
Interoperability and APIs are crucial; modern research tooling must integrate smoothly with other platforms to meet diverse stakeholder needs and workflows.
Notable Quotes
"If research is going to slow down the product process, most companies will end up releasing those products without doing the research."
"Participants themselves need to be real humans at the end of the day to get unique insights."
"High-quality participants are the fuel that makes the whole research operation engine run smoothly."
"We’re not trying to change behavior, but help researchers in their existing processes to make research faster."
"Synthetic users might be okay for finding average behaviors, but they won’t replace unique insights from real users."
"Research is democratized: if you’re not democratizing, you probably don’t even realize everyone in your company is talking to users in different ways."
"As more software is being built for specific personas, precise participant targeting becomes more important over time."
"Building ecosystems of interconnected tools that work seamlessly is crucial for modern, fast-moving organizations."
"No matter what your contract says, once your data is in the cloud connected to an LLM, you have to accept the risk it could be exposed."
"Research’s role may shift to orchestrators of AI-synthesized insights and gap analyses rather than just primary data collectors."
Or choose a question:
More Videos
"Coaches organize practices or drills to push players toward specific goals and improvement."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
"Validity is the degree to which evidence and theory support the interpretations of test scores for proposed uses."
Chris EngledowlA Mixed Method Approach to Validity to Help Build Trust
April 28, 2023
"Authentic leadership can be characterized as genuine, self-aware, and transparent."
Etienne FangThe Power of Care: From Human-Centered Research to Humanity-Centered Leadership
March 10, 2021
"Failing to design for disabilities means failing to design for our future selves."
Samuel ProulxDesigning beyond caricatures: Embracing real, diverse user needs
December 4, 2024
"Decision culture is a better lens than data culture for thinking about what decisions we're trying to facilitate with AI."
Brian T. O’Neill Maria Cipollone Luis Colin Manuel Dahm Mike OrenDoes Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
February 18, 2022
"Shipping smaller, less complex side projects helps build team morale and energizes us for the big slow work."
Barb SpantonDoing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
June 10, 2022
"Urban air mobility business is expected to be profitable by 2028, helping solve dense city congestion."
Teresa SwinglerLook, Up in the Sky! UX/UI for Aerospace
October 27, 2022
"Your metrics allow you to tell data-supported stories to communicate progress effectively."
Peter BoersmaHow to Define and Maintain a DesignOps Roadmap
October 3, 2023
"You’re hired for the wrong reasons—those buzzwords and expensive stamps aren’t what really make you successful."
Mackenzie GuinonM.C. Escher’s UX Research Career Ladder
March 9, 2022
