Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population

Gold
Wednesday, June 9, 2021 • Design at Scale 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx and Abid Virani from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Assistive technologies mainly split into screen readers, screen magnifiers, and alternative navigation devices, each with distinct user needs.

  • Screen reader users heavily rely on semantic web structure and proper labeling for efficient navigation.

  • Magnification users often supplement their experience with screen reader features to reduce eye strain.

  • Alternative navigation users use multiple input methods like voice commands and head mice, providing fallback options.

  • Traditional usability labs and standard SUS questionnaires fail to consider unique accessibility challenges and setup of assistive tech users.

  • SUS questions like needing technical support or learning speed are confusing or irrelevant to assistive tech users without adaptation.

  • Fable created the Accessible Usability Scale to better evaluate assistive tech user experience by adapting question language and scope.

  • Preliminary AUS data indicates screen reader users experience the lowest usability scores due to lack of backup input methods.

  • Remote usability testing greatly increases participation and authentic results by allowing users to test in familiar, customized environments.

  • User skill with assistive tech, experience level, and mental models vary significantly and must be considered beyond linear novice-expert scales.

Notable Quotes

"Assistive technology includes software and hardware that people with disabilities use to access computers."

"Screen readers let us jump directly to content, replicating visual skimming of a web page."

"Expert screen reader users listen at over 300 words per minute and still fully understand the content."

"Magnification can cover the entire screen two to ten times, and users pan around to see different areas."

"Many magnification tools also have screen reader functions to reduce eye strain and help users."

"Alternative navigation users might use voice commands, head mice, or grid coordinates to access elements."

"Traditional usability labs often force assistive tech users to use unfamiliar setups, creating barriers."

"I am a technical person, yet I might still need someone who can see to help me use certain sites."

"Accessibility is a spectrum; if frequent tasks require assistance, the product is inaccessible for me."

"Remote testing helps get closer to real-world results because users are in environments customized for them."

Ask the Rosenbot
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Ovetta Sampson
Managing the Human Engagement Risks of AI
2025 • Designing with AI 2025
Gold
Alicia D. Johnson
Disasters and the 21st Century
2021 • Civic Design 2021
Gold
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Eduardo Ortiz
Day 3 Theme Panel
2025 • Advancing Research 2025
Gold
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
Landon Barnes
Are My Research Findings Actually Meaningful?
2022 • Advancing Research 2022
Gold
Allan Lowson
Rehashing the Double Diamond: Collaborating across functions with AI-assisted prototyping
2026 • Designing with AI 2026
Conference
Sheri Byrne-Haber
The Importance of Accessible Design Systems
2024 • DesignOps Summit 2020
Gold
Fisayo Osilaja
[Demo] The AI edge: From researcher to strategist
2024 • Designing with AI 2024
Gold
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Dianne Que
Real Talk: Proving Value through a Scrappy Playbook
2019 • DesignOps Summit 2019
Gold
Boon Yew Chew
Making Sense of Systems—and Using Systems to Make Sense of the Enterprise
2023 • Enterprise UX 2023
Gold
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold

More Videos

Amy Thibodeau

"Many culture-building moments at Shopify happen because individual contributors see opportunity and take action."

Amy Thibodeau

Opening Keynote: Process and Ambiguity

October 23, 2019

Carl Turner

"The difference between the way people talk about how things are done and how they are actually done reveals unconscious assumptions."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

Bruce Gillespie

"Choose plain, everyday words over jargon to meet your audience where they are."

Bruce Gillespie

Learning from journalism: Balancing impactful communication with compassionate storytelling

March 13, 2025

Aurobinda Pradhan

"Design managers need predictable roadmaps and healthy teams to meet project goals and timelines."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022

Taylor Jennings

"Tags are a balance; project tags are wild and flexible, global tags must be controlled to avoid chaos."

Taylor Jennings Joe Nelson Alex Knoll

Repository Retrospective: Learnings from Introducing a Central Place for UX Research

March 9, 2022

Daniel J. Rosenberg

"You have to keep the injection sites moving because of scar tissue, adding to the body hacking complexity."

Daniel J. Rosenberg

Digital Medicine Design

September 26, 2019

Jack Moffett

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Jack Moffett

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

September 22, 2022

Christian Crumlish

"These bots will say yes to all your ideas, whether they're good or bad—that's the rocket to Mars anti-pattern."

Christian Crumlish

The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…

August 14, 2025

Alexia Cohen

"Community-centered design allowed us to uplift the value of lived experience and embed it directly into budgeting."

Alexia Cohen Adriane Ackerman

Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona

December 4, 2024