Rosenverse
SUS: A System Unusable for Twenty Percent of the Population

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • •

    Screen readers allow users to navigate web pages quickly by jumping through well-structured headings and content.

  • •

    Low vision users often rely on system-wide screen magnification and color inversion settings to reduce eye strain.

  • •

    Alternative navigation methods like head mice and voice dictation are selected based on task and user condition, not used exclusively.

  • •

    Traditional lab-based usability research often prioritizes convenience over real assistive technology configurations, leading to inaccurate results.

  • •

    Assistive technology users rarely use default settings; they extensively customize tools over time for optimal use.

  • •

    The System Usability Scale (SUS) includes questions that confuse assistive technology users and do not capture their true experience.

  • •

    Fable’s Accessible Usability Scale adapts SUS questions to better reflect the experience of assistive technology users.

  • •

    Initial data shows screen reader users report significantly lower usability scores (mid-50s) compared to screen magnification users (low 60s).

  • •

    Users’ lowered expectations after years of experience may mask the true severity of usability issues in assistive technology contexts.

  • •

    Measuring accessibility usability accurately enables benchmarking and progress in improving digital products for all users.

Notable Quotes

"I’ve been using screen readers for 30 years and accessibility has always been a passion of mine."

"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."

"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."

"No assistive technology user uses default settings; we spend years customizing everything to work for us."

"The System Usability Scale’s question about needing a technical person to use the system is confusing and inaccurate for screen reader users."

"Most people with my assistive technology might learn to use the system at a different pace than non-disabled users."

"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."

"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."

Ask the Rosenbot
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire
2022 • Civic Design Community
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Maria Giudice
Becoming a Changemaker by Leading with Design
2023 • Advancing Research 2023
Gold
Josh Clark
Sentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
2025 • Rosenfeld Community
Malini Rao
Lessons Learned from a 4-year Product Re-platforming Journey
2021 • Design at Scale 2021
Gold
Dave Malouf
The Future of DesignOps
2024 • DesignOps Summit 2020
Gold
Hang Xu
Live Sensemaking: How Might We Shape Tools that Extend Us at Every Level, from Product to Workflow to Community?
2026 • Shift UX 2026
Conference
Christian Rohrer
Research Operations at Scale
2017 • DesignOps Summit 2017
Gold
Prayag Narula
How to Empower Your Designers to Do Good Research – And Why You Want To
2022 • Design at Scale 2022
Gold
Peter Van Dijck
Designing AI-first products on top of a rapidly evolving technology
2025 • Designing with AI 2025
Gold
Kate Kalcevich
Integrating Accessibility in DesignOps
2024 • DesignOps Summit 2024
Gold
Alëna Iouguina
Designing Systems at Scale
2018 • DesignOps Summit 2018
Gold
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold

More Videos

Dr. Karl Jeffries

"An elite athlete doesn’t turn up at the Olympics and do their thing without coaches, physios, nutritionists."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"Making your chief legal officer your best friend as a designer makes a lot of sense."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Trust is built by showing you’re there to help make them succeed, not just push your agenda."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"Constant communication is necessary; agreement emails can’t be one-and-done."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"For the right audience, if applied correctly, humor and music can move people in many ways."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"The ultimate measure is bringing value so people invite you back to work with them again and again."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"We think about research as the magnetic field that attracts every part of the business into alignment around the customer."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"Nobody loves it when someone from another department shows up to tell people how to do their jobs better."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"Combining the what we see in data with the why we get from user research is where true insights live."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books