Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is crucial before product development to validate market need but is underutilized in UX research.

  • Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.

  • Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.

  • Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.

  • Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.

  • Including pricing in concept tests impacts user responses and business decisions significantly.

  • Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.

  • Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.

  • Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.

  • Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.

Notable Quotes

"Concept testing is about testing ideas before development to confirm there is a real need for the product."

"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."

"People care not about product features but what these features do for them."

"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."

"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."

"If you have limited resources, start with a simple monadic test using low-cost survey tools."

"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."

"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."

"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."

"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."

Ask the Rosenbot
Amy Parness
Scaling Sustainability: Complementary strategies that drive long-term success
2025 • Climate UX Interest Group
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Dianne Que
Real Talk: Proving Value through a Scrappy Playbook
2019 • DesignOps Summit 2019
Gold
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Ashley Cortez
Shifting Toward Community-Led Innovation in Local Government
2021 • Civic Design 2021
Gold
Bob Baxley
Theme 4: Discussion
2024 • Enterprise Experience 2020
Gold
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold
Brian Moss
What Does it Mean to be a Resilient Research Team?
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
Day 1 Welcome
2024 • DesignOps Summit 2024
Gold
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group
Noz Urbina
Rapid AI-powered UX (RAUX): A framework for empowering human designers
2025 • Rosenfeld Community
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How
2021 • Advancing Research Community

More Videos

Nalini Kotamraju

"After the move, our work had more impact, more visibility, and we're present across the entire product life cycle."

Nalini Kotamraju

Research After UX

March 25, 2024

Dean Broadley

"If you want to go fast, go alone; if you want to go far, go together."

Dean Broadley

Not Black Enough to be White

January 8, 2024

Denise Jacobs

"Silence is complicity. Inaction is support."

Denise Jacobs Nancy Douyon Renee Reid Lisa Welchman

Interactive Keynote: Social Change by Design

January 8, 2024

Kim Fellman Cohen

"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."

Kim Fellman Cohen

Measuring the Designer Experience

October 23, 2019

George Aye

"Good design is honest and yes, the Jewel e-cigarette will honestly kill you."

George Aye

That Quiet Little Voice: When Design and Ethics Collide

November 16, 2022

Nathan Curtis

"You have to treat the design system like a product that everyone in your organization will use."

Nathan Curtis

Beyond the Toolkit: Spreading a System Across People & Products

June 9, 2016

Greg Petroff

"Compass is a pretty frank place where people feel safe to speak their minds, even at leadership levels."

Greg Petroff

The Compass Mission

March 10, 2021

Chloe Amos-Edkins

"Digital connectivity is necessary for participation in society, but half the world lacks internet access."

Chloe Amos-Edkins

A Cultural Approach: Research in the Context of Glocalisation

March 27, 2023

Mackenzie Cockram

"The new site had a 19% dropout rate compared to 32% on the old site, showing clear improvement."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022