Rosenverse
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.

  • Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.

  • Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.

  • Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.

  • Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.

  • Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.

  • ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.

  • Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.

  • Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.

  • ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.

Notable Quotes

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."

"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Ask the Rosenbot
Greg Petroff
Everything is About to Change: Software as Material
2016 • Enterprise UX 2016
Gold
Sol Mesz
Hands or Brains? How to Hire for Strategy, Strategically
2024 • Enterprise Experience 2020
Gold
Steve Portigal
The Future of Research: Bridging the Gaps
2021 • Advancing Research Community
Jen Cardello
Curating insight: Strategies for integrating knowledge across research functions
2025 • Advancing Research 2025
Gold
Peter Merholz
The Mysterious Case of the Missing UX Career Path
2022 • DesignOps Community
Shawna Hein
Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
2022 • Civic Design 2022
Gold
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
John Devanney
The Design Management Office
2017 • DesignOps Summit 2017
Gold
Jorge Arango
The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)
2024 • Rosenfeld Community
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold
Cheryl Platz
Embrace Your Fun Factor: Game Development Best Practices for Product Design
2026 • Rosenfeld Community
Sharon Bautista
Time to Make the Donuts: How User Research Helped Bridge Disparate Teams
2024 • Enterprise Experience 2020
Gold
Maverick Chan
From Doodle to Demo: AI as Our Storytelling Partner
2025 • Rosenfeld Community
Tricia Wang
Spatial Collapse: Designing for Emergent Culture
2024 • Enterprise Experience 2020
Gold
Michal Anne Rogondino
Saving Outer Space: The First UX Design System for Our Nation’s Satellites
2024 • Enterprise Experience 2020
Gold
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community

More Videos

Sheryl Cababa

"AI moves the practitioner into an editorial or supervisory role, which often signals de-skilling."

Sheryl Cababa Ethan Marcotte Milena Pribic

Day 2 Panel

June 5, 2024

Katie Johnson

"Turn capping helps reset the model to prevent drift but introduces new problems around memory."

Katie Johnson

Disrupting generative AI products with just-in-time consumer insights

June 4, 2024

Sofia Quintero

"Data entry is the enemy; automation is the key to making research repositories successful."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Sam Proulx

"Android’s accessibility tools started later than Apple’s, so the community is smaller and less documented."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

March 27, 2023

Jules Monza

"Consistency is key in large organizations to make sure you’re measuring the same things and talking about them the same way."

Jules Monza

Use These Words and Count These Things

September 25, 2024

Bria Alexander

"Design ops is still defining its service offering and must articulate value both internally and to business partners - Zi."

Bria Alexander Patrizia Bertini Peter Boersma Jon Fukuda Dave Malouf Theresa Slate Changying (Z) Zheng

Charting the future of DesignOps: A community workshop

April 18, 2024

Bria Alexander

"MJ Broadbent’s sketchnotes are absolutely outstanding. You really do not have to take notes yourself."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Dave Malouf

"Break your design system components and stress test them to see where they break so you can improve them."

Dave Malouf Amy Thibodeau

Panel: Design Systems and Documentation

November 7, 2017

Jon Temple

"Building strong relationships with procurement helps you understand and navigate their constraints and speeds up processes."

Jon Temple Kalee Dankner Bruce Falk Lauren Galanter

Panel: Stacks, Security, and Stakeholders: The Hidden Work of UXR Tool Procurement

March 12, 2026