Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.

  • Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.

  • Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.

  • Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.

  • Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.

  • Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.

  • ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.

  • Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.

  • Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.

  • ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.

Notable Quotes

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."

"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Ask the Rosenbot
Jen Briselli
Learning Is The Engine: Designing & Adapting in a World We Can’t Predict
2025 • Rosenfeld Community
Adel Du Toit
Get Your CFO To Say: 'Our Strategic Goal is User Obsession'
2022 • Design at Scale 2022
Gold
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Rich Mironov
How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
2022 • Design in Product 2022
Gold
Jack Moffett
SAFe or Sorry?
2019 • Enterprise Community
Kate Towsey
Participant Recruitment and Management Tools
2026 • Advancing Research 2026
Conference
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Chelsey Glasson
Exit Interview #3: Same as It Ever Was: What Leaving Tech Taught Me About Change
2025 • Rosenfeld Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Jaime Creixems
Best Practices when Creating and Maintaining a Design System
2023 • Enterprise UX 2023
Gold
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Gabrielle Verderber
Documentation Your Team Will Actually Use
2023 • DesignOps Summit 2023
Gold

More Videos

Erin Hauber

"Maybe the ambiguity and frequent changes in SAFe could actually be an opportunity, not just a headache."

Erin Hauber

Design is Not the Frosting on the Scaled Agile Layer Cake

October 24, 2019

Uday Gajendar

"Jenny and Will will take a foundational look at wielding data visualization and product analytics effectively."

Uday Gajendar

Theme Four Intro

June 6, 2023

Sam Proulx

"Accessibility isn’t a checkbox you run automated tests for; you must involve people with disabilities to benchmark success."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Jeff Ephraim Bander

"Eye tracking is not the holy grail, but it’s an awesome method to understand what the user is thinking."

Jeff Ephraim Bander Ariane Rahn Philipp Reiter

Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research

March 11, 2022

Susan Simon-Daniels

"The fundamental things do apply as time goes by."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Robin Beers

"You have to understand the power dynamics around the table—seniority, function, gender, skin color, religion—they all matter."

Robin Beers Nalini Kotamraju Andy Warr

Panel: Excellence in Communicating Insights

March 26, 2024

Jemma Ahmed

"Defiance is not loud or theatrical; it is bravery and clarity."

Jemma Ahmed

Theme 1 Intro

March 10, 2026

Christopher Geison

"Layoffs wiped out 20, 50, even 75% of research teams in profitable companies."

Christopher Geison

Theme 1 Intro

March 25, 2024

Bianca Jefferson

"Teams started shipping multiple new features every few weeks, not because they cut corners, but because of fewer false starts."

Bianca Jefferson

From Sprints to Systems: Operationalizing Continuous Discovery Through DesignOps

September 10, 2025