Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Or choose a question:
More Videos
"Shared mental models serve as organizing frameworks that all players in the system can understand and make decisions within."
Shanti Mathew Natalie Sims Natalia RadywylCivic Design at Scale: Introducing the Public Policy Layer Cake
December 9, 2021
"There’s a lot of pressure on ops people and managers to make everything perfect all the time for staff."
Tess DixonC'mon Get Happy
September 29, 2021
"AI isn’t about being an expert for most roles yet, but being AI conversant and experimental is crucial."
Dave Hoffer Joanne WeaverUX Job Search AMA #3 with Joanne Weaver and Dave Hoffer
July 16, 2025
"Find the loudest respected person on the team and get their buy-in; they can fast track weeks of work in getting everyone else on board."
Louis Rosenfeld Jose Coronado Rachel Posman Guneet Singh Crystal YanThe Bigger Picture: A Panel Discussion
October 23, 2019
"Design ops is a change leadership function because you have to influence people you often have no formal authority over."
Jon FukudaStorytelling for DesignOps
August 17, 2023
"Trust building and informed consent are things you can improve in research without stressing the business."
Jemma Ahmed Robert Fabricant Sean McKay Llewyn Paine Kate Towsey Noah BondTheme Panel
March 11, 2025
"High-level leadership changes in government often result in shifts in organizational moods and priorities."
Kara KaneTheme One Intro
November 16, 2022
"No reconfiguring, no manual tweaks, no app hopping. One place, one view, and a system that finally works for the people living in it."
Tristin OldaniLearning the Part I Used to Hand Off: How Building the Systems Made Me a Better Designer
August 20, 2026
"Researchers often treat users as checkboxes, going in, doing research, checking the box and leaving."
Prayag Narula Rida QadriHCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
March 28, 2023
