Rosenverse
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.

  • Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.

  • Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.

  • Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.

  • Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.

  • Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.

  • ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.

  • Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.

  • Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.

  • ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.

Notable Quotes

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."

"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Ask the Rosenbot
Megan Blocker
Theme 2 Intro
2025 • Advancing Research 2025
Gold
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
John Calhoun
Two Sides of the DesignOps Coin: Teams Ops and Product Ops
2024 • DesignOps Summit 2020
Gold
Jen Cardello
Learning Velocity—The Insights Speedometer
2021 • Advancing Research Community
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Joy KendiMwiti
Deciding when to automate: Integrating AI in high-stakes systems
2026 • Designing with AI 2026
Conference
Dave Malouf
The Past, Present, and Future of DesignOps: a 2-part DesignOps Community Call (Part 2)
2022 • DesignOps Community
Devon Powers
Imagining Better Futures
2022 • Advancing Research 2022
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Ana Ferreira
Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
2024 • DesignOps Summit 2020
Gold
Rachel Radway
The Many Paths Of Design Operations
2022 • DesignOps Summit 2022
Gold
Erin May
Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
2022 • Advancing Research 2022
Gold
Adam Thomas
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
2022 • Design in Product 2022
Gold
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold

More Videos

Maria Rosala

"Personally, if I was gonna go into some aspect of UX research, I would jump in with both feet into research repositories."

Maria Rosala Shivanjali M.

Research Repositories

March 12, 2026

Dan Saffer

"Consequences scanning helps detect unintended harms and risks before launching AI features."

Dan Saffer

Why AI projects fail (and what we can do about it)

May 14, 2025

Melissa Eggleston

"The effect you have on others is the most valuable currency there is."

Melissa Eggleston Maya Israni Florence Kasule Owen Seely Andrea Schneider

Practical People Skills for Building Trust on Teams and with Partners

December 9, 2021

"Align on what you’re looking for before the interview to evaluate non-traditional candidates fairly."

Discussion

June 9, 2017

Satyam Kantamneni

"What if you get a notification when you drive into a dealership and all your details are ready?"

Satyam Kantamneni

Do You Have an Experience Vision?

March 23, 2023

Richard Buchanan

"Creativity means a change in perception, moving from what is familiar to what may seem ridiculous initially."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Victor M. Gonzalez

"Our apprentice program is free and intense, combining foundational training with real-world projects over six months."

Victor M. Gonzalez

Practicing Learners and Learning Practitioners

March 10, 2021

Christian Rohrer

"Risk-sharper is a role assigned within Risk Management that carries teams through the risk process to mitigate it."

Christian Rohrer

Research Operations at Scale

November 7, 2017

Michelle Morrison

"As soon as we started working from home, I sent an urgent email to say we have to change our strategy and experiment with new things."

Michelle Morrison

Culture Design

May 21, 2020