Rosenverse
SUS: A System Unusable for Twenty Percent of the Population

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population

Gold
Wednesday, June 9, 2021 • Design at Scale 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx and Abid Virani from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Assistive technologies mainly split into screen readers, screen magnifiers, and alternative navigation devices, each with distinct user needs.

  • Screen reader users heavily rely on semantic web structure and proper labeling for efficient navigation.

  • Magnification users often supplement their experience with screen reader features to reduce eye strain.

  • Alternative navigation users use multiple input methods like voice commands and head mice, providing fallback options.

  • Traditional usability labs and standard SUS questionnaires fail to consider unique accessibility challenges and setup of assistive tech users.

  • SUS questions like needing technical support or learning speed are confusing or irrelevant to assistive tech users without adaptation.

  • Fable created the Accessible Usability Scale to better evaluate assistive tech user experience by adapting question language and scope.

  • Preliminary AUS data indicates screen reader users experience the lowest usability scores due to lack of backup input methods.

  • Remote usability testing greatly increases participation and authentic results by allowing users to test in familiar, customized environments.

  • User skill with assistive tech, experience level, and mental models vary significantly and must be considered beyond linear novice-expert scales.

Notable Quotes

"Assistive technology includes software and hardware that people with disabilities use to access computers."

"Screen readers let us jump directly to content, replicating visual skimming of a web page."

"Expert screen reader users listen at over 300 words per minute and still fully understand the content."

"Magnification can cover the entire screen two to ten times, and users pan around to see different areas."

"Many magnification tools also have screen reader functions to reduce eye strain and help users."

"Alternative navigation users might use voice commands, head mice, or grid coordinates to access elements."

"Traditional usability labs often force assistive tech users to use unfamiliar setups, creating barriers."

"I am a technical person, yet I might still need someone who can see to help me use certain sites."

"Accessibility is a spectrum; if frequent tasks require assistance, the product is inaccessible for me."

"Remote testing helps get closer to real-world results because users are in environments customized for them."

Ask the Rosenbot
Prayag Narula
HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
2023 • Advancing Research 2023
Gold
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Erin Weigel
Real-world lessons to improve your conversion rates
2024 • Rosenfeld Community
Harry Max
Priority Zero: Some Things are More Equal than Others
2016 • Enterprise UX 2016
Gold
Neil Barrie
Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
2024 • Advancing Research 2024
Gold
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Jemma Ahmed
Research at an inflection point: Adapting to a new era of collaboration, equity, and innovation
2025 • Advancing Research 2025
Gold
Carl Turner
You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
2023 • Advancing Research 2023
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Taylor Jennings
Research Debate Club
2026 • Advancing Research 2026
Gold
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community

More Videos

Eniola Oluwole

"People saw small changes as having very large impact; a half-percent increase in conversion could mean 12 million dollars in revenue."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Claire Dhoosche

"Acceleration without losing quality is a company-wide goal, not just a design, product, or tech goal."

Claire Dhoosche

Coordinating chaos: Preventing workflow fragmentation when everyone accelerates with AI

June 9, 2026

Kristin Skinner

"2020 was challenging but joyful; it was a place where people could be authentic and talk about burnout and attrition."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Samuel Proulx

"One in four people in the United States have a disability."

Samuel Proulx

From Standards to Innovation: Why Inclusive Design Wins

September 10, 2025

Mary-Lynne Williams

"Meditation isn’t about stopping thinking, it’s about becoming aware of thinking."

Mary-Lynne Williams

Exit Interview #4: From Product Design Leadership to Sound Healing

January 14, 2026

Ben Reason

"Designers act as mediators and neutral parties to get stuck projects unstuck through design diplomacy."

Ben Reason Aline Horta Majid Iqbal Fabiano Leoni

Making the system visible: The fastest path to better decisions

November 20, 2025

John Donmoyer

"I generated a Tailwind color palette with AI that took seconds, compared to what used to take me some time manually."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Peter Van Dijck

"A constitution is a very good exercise: write down your system’s principles and values to help guide its behavior."

Peter Van Dijck

Hands-on AI #2: Understanding evals: LLM as a Judge

October 15, 2025

Jose Coronado

"Before design operations was a thing, design managers had to do everything, from recruiting to career ladders."

Jose Coronado

From Zero to Hero

September 8, 2022