Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • Screen readers allow users to navigate web pages quickly by jumping through well-structured headings and content.

  • Low vision users often rely on system-wide screen magnification and color inversion settings to reduce eye strain.

  • Alternative navigation methods like head mice and voice dictation are selected based on task and user condition, not used exclusively.

  • Traditional lab-based usability research often prioritizes convenience over real assistive technology configurations, leading to inaccurate results.

  • Assistive technology users rarely use default settings; they extensively customize tools over time for optimal use.

  • The System Usability Scale (SUS) includes questions that confuse assistive technology users and do not capture their true experience.

  • Fable’s Accessible Usability Scale adapts SUS questions to better reflect the experience of assistive technology users.

  • Initial data shows screen reader users report significantly lower usability scores (mid-50s) compared to screen magnification users (low 60s).

  • Users’ lowered expectations after years of experience may mask the true severity of usability issues in assistive technology contexts.

  • Measuring accessibility usability accurately enables benchmarking and progress in improving digital products for all users.

Notable Quotes

"I’ve been using screen readers for 30 years and accessibility has always been a passion of mine."

"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."

"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."

"No assistive technology user uses default settings; we spend years customizing everything to work for us."

"The System Usability Scale’s question about needing a technical person to use the system is confusing and inaccurate for screen reader users."

"Most people with my assistive technology might learn to use the system at a different pace than non-disabled users."

"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."

"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."

Ask the Rosenbot
JD Buckley
COMMUNICATE: Discussion
2018 • Enterprise Experience 2018
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Liwei Dai
The Heart and Brain of the AI Research
2020 • Advancing Research 2020
Gold
Alexandra Schmidt
Why Ethics Can't Save Tech
2022 • Civic Design 2022
Gold
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Josh Clark
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
2025 • Rosenfeld Community
Amanda Kaleta-Kott
The Joys and Dilemmas of Conducting UX Research with Older Adults
2022 • Advancing Research 2022
Gold
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Louis Rosenfeld
Coffee with Lou
2024 • Rosenfeld Community
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Dan Willis
Enterprise Storytelling Sessions
2016 • Enterprise UX 2016
Gold
Russ Unger
Onboarding: The Ecosystem, not the Afterthought
2017 • DesignOps Summit 2017
Gold
David Sternberg
Uncovering the hidden forces shaping user behavior
2025 • Rosenfeld Community

More Videos

Nicole Aleong

"Management consultants sell solutions to problems, not just research data, which is why they command high fees."

Nicole Aleong Michaela Mora Prayag Narula Brianna Sylver

What UX research can learn from other research practices [Advancing Research Community Workshop Series]

September 14, 2023

Laura Klein

"People don’t actually hate innovation; they like their jobs and feel threatened by change."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Erin Weigel

"An accessible product is not only the right thing to do, it’s also good for business."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024

Changying (Z) Zheng

"Once we treat AI as intelligence, we face questions about trust, collaboration, and decision making."

Changying (Z) Zheng

Navigating Innovation with Integrity

September 25, 2024

Dagmara Kukawka

"Teams openly said they didn’t know how to ask questions before and discovered research is cool afterwards."

Dagmara Kukawka

Tiny team, moonshot impact: Democratizing research across continents

March 10, 2026

Elana Chapman

"If you’re not doing anything about accessibility, you’re discriminating against your future self."

Elana Chapman Li Wen Huang Divyen Sanganee Annabel Weiner

Getting started with accessibility research

February 20, 2025

Iain McMaster

"When product says no to design, it’s not personal—it’s about prioritization and what’s most urgent right now."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023

Ian Swinson

"People care about titles way too much. I had a guy whose business card said star-bellied sneak—love that."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Paula Bach

"Habit changes sometimes must happen, but measuring and designing to respect them avoids mortifying changes."

Paula Bach

Improving Legacy Software: How Much Better Does it Have to Be?

March 11, 2022