Rosenverse
SUS: A System Unusable for Twenty Percent of the Population

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • •

    Screen readers allow users to navigate web pages quickly by jumping through well-structured headings and content.

  • •

    Low vision users often rely on system-wide screen magnification and color inversion settings to reduce eye strain.

  • •

    Alternative navigation methods like head mice and voice dictation are selected based on task and user condition, not used exclusively.

  • •

    Traditional lab-based usability research often prioritizes convenience over real assistive technology configurations, leading to inaccurate results.

  • •

    Assistive technology users rarely use default settings; they extensively customize tools over time for optimal use.

  • •

    The System Usability Scale (SUS) includes questions that confuse assistive technology users and do not capture their true experience.

  • •

    Fable’s Accessible Usability Scale adapts SUS questions to better reflect the experience of assistive technology users.

  • •

    Initial data shows screen reader users report significantly lower usability scores (mid-50s) compared to screen magnification users (low 60s).

  • •

    Users’ lowered expectations after years of experience may mask the true severity of usability issues in assistive technology contexts.

  • •

    Measuring accessibility usability accurately enables benchmarking and progress in improving digital products for all users.

Notable Quotes

"I’ve been using screen readers for 30 years and accessibility has always been a passion of mine."

"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."

"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."

"No assistive technology user uses default settings; we spend years customizing everything to work for us."

"The System Usability Scale’s question about needing a technical person to use the system is confusing and inaccurate for screen reader users."

"Most people with my assistive technology might learn to use the system at a different pace than non-disabled users."

"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."

"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."

Ask the Rosenbot
Surya Vanka
Unleashing Swarm Creativity to Solve Enterprise Challenges
2021 • Design at Scale 2021
Gold
Alicia Mooty
Design Staffing Models
2021 • DesignOps Summit 2021
Gold
Laura Weiss
There is No Playbook: Leader as Coach During Challenging Times
2024 • Rosenfeld Community
Scher Foord
Turn the Ship Around: How to Apply Design Thinking Across Your Organization
2021 • Design at Scale 2021
Gold
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Erin Weigel
UX Lessons from running more than 1,200 A/B Tests
2024 • Rosenfeld Community
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Hugh Dubberly
Problems with Problems: Reconsidering the Frame of Designing as Problem-Solving
2019 • Enterprise Community
Julie Norvaisas
Back to basics, or start from scratch?
2025 • Advancing Research 2025
Gold
Sharon Bautista
Time to Make the Donuts: How User Research Helped Bridge Disparate Teams
2024 • Enterprise Experience 2020
Gold
Erin Weigel
Get Your Whole Team Testing to Design for Impact
2024 • Rosenfeld Community
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Gillian Salerno-Rebic
From Insight to Impact: How JourneySpark Used WEVO Pulse + Pro to Drive a 50% Lift in Ad Engagement
2025 • Designing with AI 2025
Gold
Alastair Simpson
Debunking the Myths of Cross-Disciplinary Collaboration
2019 • DesignOps Summit 2019
Gold
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold
Louis Rosenfeld
Day 1 Welcome
2024 • DesignOps Summit 2024
Gold

More Videos

Nancy Douyon

"If you put garbage in, garbage comes out – AI reflects the biases in its training data."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Jack Behar

"Using Merge we’re closing the loop of documentation and empowering stakeholders to communicate via common jargon and components."

Jack Behar

How to Build Prototypes that Behave like an End-Product

December 6, 2022

Jorge Arango

"A design project can become the catalyst for conversations where teams realize they have not talked to each other."

Jorge Arango

Meeting of the Waters: Designing for Successful Inorganic Growth

August 12, 2021

Jon White

"An insight is a finding plus an opinion — it’s the so what of it all."

Jon White Erin May

Unsticking Research for Better Information Flow

March 11, 2026

Jessamyn Edwards

"Give a why of why you’ve made this design decision. It helps your team understand and reduces defensiveness."

Jessamyn Edwards

Surviving Your UX Career in Enterprise Design

December 2, 2021

Stefanie Owens

"It can be hard for designers to immediately understand or advocate for the real value of design at deeper technical layers."

Stefanie Owens

Optimizing for Outcomes: Transformation Design in Systems at Scale

December 4, 2024

Ron Bronson

"Friction can be good, especially when protecting private information."

Ron Bronson

Design, Consequences & Everyday Life

November 18, 2022

Louis Rosenfeld

"Imagine a world where research bots at IBM talk to the Rosen bot to give you better guidance on interpreting research."

Louis Rosenfeld

The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld

June 5, 2024

Ash Brown

"Every small initiative can lead to significant change when multiplied across communities."

Ash Brown

Silver Linings: What DesignOps Learned in the Shift to WFH

October 23, 2020

Latest Books All books