Rosenverse
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions

Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • •

    Concept testing is crucial before product development to validate market need but is underutilized in UX research.

  • •

    Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.

  • •

    Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.

  • •

    Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.

  • •

    Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.

  • •

    Including pricing in concept tests impacts user responses and business decisions significantly.

  • •

    Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.

  • •

    Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.

  • •

    Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.

  • •

    Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.

Notable Quotes

"Concept testing is about testing ideas before development to confirm there is a real need for the product."

"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."

"People care not about product features but what these features do for them."

"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."

"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."

"If you have limited resources, start with a simple monadic test using low-cost survey tools."

"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."

"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."

"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."

"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."

Ask the Rosenbot
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Jorge Arango
The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)
2024 • Rosenfeld Community
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Trisha Terhar
Empathizing with the Empowered: Non-Researcher Responses to Democratization
2022 • Advancing Research 2022
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Gold
Victor Udoewa
Theme One Intro
2023 • Advancing Research 2023
Gold
Roberta Dombrowski
5 Reasons to Bring your Recruiting in House
2021 • DesignOps Summit 2021
Gold
Daniel Gloyd
Designing Warmth
2025 • Rosenfeld Community
Vanessa Varin
Feedback: The Other F-Word
2025 • DesignOps Summit 2025
Gold
Amelia Cole
Data-Prompted Interviews
2021 • QuantQual Interest Group
Dave Gray
Connection, Community, and the Future of Work
2026 • Rosenfeld Community
Peter Merholz
The Trials and Tribulations of Directors of UX
2023 • Enterprise Community
Dianne Que
Real Talk: Proving Value through a Scrappy Playbook
2019 • DesignOps Summit 2019
Gold
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community

More Videos

Matt Duignan

"The challenge is whether your organization has the energy to overcome cultural and technical barriers driving researchers back to disposable knowledge."

Matt Duignan

Atomizing Research: Trend or Trap

March 30, 2020

Shreya Dhawan

"Building psychological safety and trust through dialogue creates organizational memory that drives change."

Shreya Dhawan Victor Udoewa Xènia Viladas Florian Vollmer

Making service tangible: the fastest path to higher performance

November 19, 2025

Dan Saffer

"Matchmaking connects AI capabilities to user needs so you find the low hanging fruit projects."

Dan Saffer

Why AI projects fail (and what we can do about it)

May 14, 2025

Michal Anne Rogondino

"This poor young airman is not entering into a super cool sci-fi command center but using apps built by their grandparents."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Kate Towsey

"Researchers are shy about sharing work because they worry about being judged — peer and management support help."

Kate Towsey Jake Burghardt

ResearchOps AMA with Kate Towsey & Jake Burghardt

October 16, 2025

Kim Fellman Cohen

"Failure isn’t discouraging; it’s an opportunity to learn and improve your approach."

Kim Fellman Cohen

Measuring the Designer Experience

October 23, 2019

Dan Willis

"Pushing my boundaries and getting out of my comfort zone helped me learn what I was capable of."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

Liam Thurston

"Our skills matrix became the center of gravity for our practice—it started writing job descriptions and guiding recruitment."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022

Janelle Estes

"If you build something that's easy to use but not what people want, it doesn't matter."

Janelle Estes

UX Research Trends

January 28, 2021

Latest Books All books