Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is crucial before product development to validate market need but is underutilized in UX research.

  • Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.

  • Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.

  • Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.

  • Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.

  • Including pricing in concept tests impacts user responses and business decisions significantly.

  • Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.

  • Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.

  • Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.

  • Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.

Notable Quotes

"Concept testing is about testing ideas before development to confirm there is a real need for the product."

"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."

"People care not about product features but what these features do for them."

"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."

"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."

"If you have limited resources, start with a simple monadic test using low-cost survey tools."

"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."

"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."

"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."

"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."

Ask the Rosenbot
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
PJ Buddhari
Meet Spectrum, Adobe’s Design System
2021 • Design at Scale 2021
Gold
Ash Brown
Silver Linings: What DesignOps Learned in the Shift to WFH
2020 • DesignOps Summit 2020
Gold
Barb Spanton
Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
2022 • Design at Scale 2022
Gold
Alexandra Schmidt
Why Ethics Can't Save Tech
2022 • Civic Design 2022
Gold
Frank Duran
Partnership Playbook: Lessons Learned in Effective Partnership
2024 • Enterprise Experience 2020
Gold
Holly Cole
Panel Discussion: Growing People and Teams
2018 • DesignOps Summit 2018
Gold
Samuel Proulx
Inclusive Research: Debunking Myths and Getting Started
2025 • Advancing Research 2025
Gold
Doug Powell
Closing Keynote: Design at Scale
2018 • DesignOps Summit 2018
Gold
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community
Bud Caddell
DesignOps Community Sensing Session
2021 • DesignOps Community
Jackie Ajoux
Leveling-Up: A Single-Player’s Guide to the DesignOps Team-of-One
2024 • DesignOps Summit 2020
Gold
Bria Alexander
Charting the future of DesignOps: A community workshop
2024 • DesignOps Community

More Videos

Erin Malone

"There’s still a need for human insight to understand behavior and apply meaningful design decisions."

Erin Malone

Understanding the past to prepare for the future

July 19, 2024

Changying (Z) Zheng

"We keep our team honest about where we are and where we need to improve — transparency and accountability."

Changying (Z) Zheng

Navigating Innovation with Integrity

September 25, 2024

Carol Massa

"Actors as standardized patients allow safe practice of healthcare scenarios when live environment testing is too risky."

Carol Massa

Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences

December 3, 2024

Bria Alexander

"If you feel uncomfortable or bullied, please let us know because it’s very important to keep the vibes positive."

Bria Alexander

Opening Remarks

October 3, 2023

Mike Oren

"The essence of strategy isn’t painting a grand vision of the future, it's deciding what not to do."

Mike Oren

Why Pharmaceutical's Research Model Should Replace Design Thinking

March 28, 2023

Feleesha Sterling

"The advantage of having one moderator is I work with all the teams pretty much and can connect the dots across products."

Feleesha Sterling

Building a Rapid Research Program

May 18, 2023

Amy Marquez

"Show them, don’t tell them — involving stakeholders early builds skin in the game and helps control quality."

Amy Marquez

INVEST: Discussion

June 15, 2018

Jay Bustamante

"Ethical stress testing subjects AI to hypothetical morally challenging scenarios to ensure alignment with ethical norms."

Jay Bustamante

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation

October 2, 2023

Lily Aduana

"If I forgot a critical screener question, I just messaged all qualified participants to confirm they meet the criteria before approval."

Lily Aduana Savannah Hobbs Brittany Rutherford

5 Reasons to Bring Your Recruiting in-House (and How To Do It)

March 12, 2021