Summary
In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!
Key Insights
-
•
ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.
-
•
Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.
-
•
Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.
-
•
Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.
-
•
Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.
-
•
Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.
-
•
ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.
-
•
Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.
-
•
Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.
-
•
ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.
Notable Quotes
"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."
"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."
"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."
"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."
"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."
"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."
"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."
"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."
"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."
"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."
Dig deeper—ask the Rosenbot:
More Videos
"Design research faces design complexity, which deals with the specific, intentional, and the non-existing."
Yoel SumitroActions and Reflections: Bridging the Skills Gap among Researchers
March 9, 2022
"Burnout exists because we made rest a reward rather than a right."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"The iPhone launch was a remarkably compelling, magnetic, and beautiful case study for the power of design."
Doug PowellDesignOps and the Next Frontier: Leading Through Unpredictable Change
September 11, 2025
"Reviewing decisions out loud held everyone accountable and made it harder for Jeff to forget or change his mind."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
"I helped a company save 12 million dollars by not investing in an iris scanner in a one-week project."
Mike OrenWhy Pharmaceutical's Research Model Should Replace Design Thinking
March 28, 2023
"Operations is like the rocket booster for design leadership."
Jacqui FreyScale is Social Work
March 19, 2020
"The V2MOM stands for Vision, Values, Methods, Obstacles, and Measures and is a framework every Salesforce employee uses."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"You own the design system, which gives you the unique ability to integrate that accessibility thinking into all of your components."
Samuel ProulxFrom Standards to Innovation: Why Inclusive Design Wins
September 10, 2025
"For early career UXers, compassion could be as simple as expressing gratitude for help."
Laine Riley ProkayHow DesignOps can Drive Inclusive Career Ladders for All
September 30, 2021
Latest Books All books
Dig deeper with the Rosenbot
How can teams effectively collaborate between different ops functions across departments to improve communication?
How can transparent candidate experience design affect hiring outcomes in design teams?
How did the Lab balance flexibility for individual project documentation with the need for an integrated knowledge system?