Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Dig deeper—ask the Rosenbot:
More Videos
"Laura let out a sigh of relief and said, I don’t think I could ever recover the way that you did."
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020
"Don’t force yourself into a job you know isn’t right just because you’re unemployed."
Corey Nelson Amy SanteeLayoffs
November 15, 2022
"Statistical significance tells you if a change is likely not random, but it does not tell you if the change matters to your business."
Landon BarnesAre My Research Findings Actually Meaningful?
March 10, 2022
"Logic models are boring but powerful tools to align expectations that behavior change is complex and not immediate."
Amy BucherHarnessing behavioral science to uncover deeper truths
March 12, 2025
"Friction isn’t just annoying; it’s a force that reshapes behavior and can slow or stop user flow."
David SternbergUncovering the hidden forces shaping user behavior
July 17, 2025
"Anecdotal feedback from team members helps leaders understand the real impact of change."
Deanna SmithLeading Change with Confidence: Strategies for Optimizing Your Process
September 23, 2024
"Power hoarding, paternalism, perfectionism—these uphold white supremacy culture in design."
Jennifer StricklandAdopting a "Design By" Method
December 9, 2021
"If adding a design program manager gives each designer back even one hour a day, you might make your entire team more efficient."
Rachel Posman John CalhounA Closer Look at Team Ops and Product Ops (Two Sides of the DesignOps Coin)
November 19, 2020
"Service design is 10% connecting the dots and 90% creating the conditions that bring those dots closer together."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
