Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Or choose a question:
More Videos
"You need support from the top down and from grassroots; those two have to meet in the middle to make change happen."
Alison Rand Sarah BrooksScaling Impact with Service Design
March 25, 2021
"At the turning point, the team realized they were in charge of their own process and got engaged."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"Our big idea was big and they wanted it, but what they wanted way more was the foundational features."
Sarah FlamionComplex Problem? Add Clarity by Combining Research and Systems Thinking
March 31, 2020
"Plans are useless, but planning is indispensable. You have to keep moving forwards even if the destination keeps changing."
Silke Bochat5 Antifragile Strategies for a DesignOps 2.0
September 23, 2024
"We don’t have meetings without all three sides of the business, product, and design coming together now."
Uday Gajendar Lada Gorlenko Dave Malouf Louis Rosenfeld Dan Willis10 Years of Enterprise UX: Reflecting on the community and the practice
June 18, 2025
"When the dot com bubble burst, I had a great design job. Unfortunately, it was at another dot com."
Dan WillisEnterprise Storytelling Sessions
June 8, 2017
"We created recruitment events for underrepresented groups because it was harder for them to get permission and sign up in time otherwise."
Kara KaneCommunities of Practice for Civic Design
April 7, 2022
"For the first time, I was able to advocate for funding directly for the research function at high executive levels."
Nalini KotamrajuResearch After UX
March 25, 2024
"We have over a thousand members in the #do-general Slack channel, and that’s where the party is at."
Bria AlexanderOpening Remarks
October 1, 2021
