Rosenverse
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.

  • Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.

  • Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.

  • Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.

  • Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.

  • Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.

  • ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.

  • Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.

  • Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.

  • ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.

Notable Quotes

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."

"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Ask the Rosenbot
Kayla Farrell
What It's Like To Be a User Researcher at Compass
2021 • Advancing Research 2021
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Mackenzie Guinon
M.C. Escher’s UX Research Career Ladder
2022 • Advancing Research 2022
Gold
Briana Thomas
When Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org
2021 • DesignOps Summit 2021
Gold
Neil Barrie
Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
2024 • Advancing Research 2024
Gold
Ryan Matthew
Bridging Design and Code: AI-Powered Design System Integration
2025 • Rosenfeld Community
Nathan Curtis
Discussion
2016 • Enterprise UX 2016
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Melissa Eggleston
Practical People Skills for Building Trust on Teams and with Partners
2021 • Civic Design 2021
Gold
Anna Avrekh
Diversity In and For Design: Building Conscious Diversity in Design and Research
2021 • Design at Scale 2021
Gold
Feleesha Sterling
Building a Rapid Research Program
2023 • Enterprise Community
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Kristin Skinner
Group Activity: A Deep Dive Into Value and Outcomes
2019 • DesignOps Summit 2019
Gold
Mike Oren
Why Pharmaceutical's Research Model Should Replace Design Thinking
2023 • Advancing Research 2023
Gold
Natalia Radywyl
Co-Designing New Power in Australia's Public Sector
2022 • Civic Design 2022
Gold

More Videos

Michal Anne Rogondino

"Military contractors didn’t have design teams; most had never invested in UX design before."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Roberta Dombrowski

"Storytelling isn’t just for qualitative research; it’s also powerful for framing quantitative data to drive decisions."

Roberta Dombrowski Sam Duong Woloszynski

Making Research a Team Sport

March 11, 2022

Rebecca Buck

"If your recreational reading is about prison camp survivorship or hostage negotiations, you might have burnout."

Rebecca Buck

Mission: Keep Talent in Research Roles!

March 10, 2021

Shipra Kayan

"I promise chief design evangelism is not religious."

Shipra Kayan

Make your research synthesis speedy and more collaborative using a canvas

January 24, 2025

Suzan Bednarz

"The screen reader sounded unintelligible—our website was a garbled mess to visually impaired users during training."

Suzan Bednarz Hilary Sunderland

AccessibilityOps for All

January 8, 2024

Anna Avrekh

"Democratizing research is about teaching people to fish, but research remains a specialized craft."

Anna Avrekh

User Research, Design, and Product - A Love Story

March 11, 2021

Johnny Michaelsen

"The behaviors act as a gauge, not a scorecard, to see who is struggling and who is thriving."

Johnny Michaelsen

Measure Behaviors, Not Results

April 23, 2026

Ian Swinson

"It’s huge to have a framework so managers and employees speak the same language around skills and growth."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Mansi Gupta

"Women are often treated as a minority, which sets them up to be forgettable, dispensable, and ignorable."

Mansi Gupta

Women-Centric Research: What, Why, How

March 29, 2023