Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Or choose a question:
More Videos
"It’s okay to be bossy because we need leaders who are opinionated and thoughtful and have a point of view."
Rachel Posman John Calhoun"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors
September 25, 2024
"Every small initiative can lead to significant change when multiplied across communities."
Ash BrownSilver Linings: What DesignOps Learned in the Shift to WFH
October 23, 2020
"Design annotations in handoffs prevent accessibility details from getting lost between designers and developers."
Gabriela BarnevaOperationalizing Inclusive Design in Service Design
November 20, 2025
"Monoculture in stories is like having just one narrative that doesn’t capture the full reality."
Kwabena Opoku Leonie Annor-Owiredu Sam LadnerMethodological toolkit for unique research impact
March 11, 2026
"Screen reader users control how metadata or tooltip voices are played, it’s a personal setting, not dictated by web designers."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"Designing community is more like gardening than building a machine."
James LangIf you can design an app, you can design a community
May 22, 2025
"Digital products aren’t like buildings; they can keep changing and moving as you need."
Tiffany ChengDesigning in a Pandemic: Integrating Speed and Rigor
June 9, 2022
"Design is the fundamental soul of a human-made creation that expresses itself in the outer layers of the product or service."
Peter MerholzDesign at Scale is People!
June 11, 2021
"When we empower others, we are actually reinforcing the hierarchy we seek to subvert."
Victor UdoewaRadical Participatory Research: Decolonizing Participatory Processes
March 9, 2022
