Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • Screen readers allow users to navigate web pages quickly by jumping through well-structured headings and content.

  • Low vision users often rely on system-wide screen magnification and color inversion settings to reduce eye strain.

  • Alternative navigation methods like head mice and voice dictation are selected based on task and user condition, not used exclusively.

  • Traditional lab-based usability research often prioritizes convenience over real assistive technology configurations, leading to inaccurate results.

  • Assistive technology users rarely use default settings; they extensively customize tools over time for optimal use.

  • The System Usability Scale (SUS) includes questions that confuse assistive technology users and do not capture their true experience.

  • Fable’s Accessible Usability Scale adapts SUS questions to better reflect the experience of assistive technology users.

  • Initial data shows screen reader users report significantly lower usability scores (mid-50s) compared to screen magnification users (low 60s).

  • Users’ lowered expectations after years of experience may mask the true severity of usability issues in assistive technology contexts.

  • Measuring accessibility usability accurately enables benchmarking and progress in improving digital products for all users.

Notable Quotes

"I’ve been using screen readers for 30 years and accessibility has always been a passion of mine."

"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."

"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."

"No assistive technology user uses default settings; we spend years customizing everything to work for us."

"The System Usability Scale’s question about needing a technical person to use the system is confusing and inaccurate for screen reader users."

"Most people with my assistive technology might learn to use the system at a different pace than non-disabled users."

"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."

"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."

Ask the Rosenbot
Nathan Shedroff
Redefining Value: Bridging the Innovation Culture Divide
2015 • Enterprise UX 2015
Gold
Séamus Byrne
Aligning Teams with Choreography
2024 • Enterprise Experience 2020
Gold
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
Phil Gilbert
A Consistent Culture of Design
2015 • Enterprise UX 2015
Gold
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
John Cutler
Prioritization for designers and product managers (1st of 3 seminars)
2024 • Rosenfeld Community
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Uday Gajendar
The Rise of Meta-Design: A Starter Playbook
2022 • Enterprise Community
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
Jessica Norris
ADHD: A DesignOps Superpower
2022 • DesignOps Summit 2022
Gold
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Advancing Research Community
Matt Bernius
Learnings from Applying Trauma-Informed Principles to the Research Process
2022 • Advancing Research 2022
Gold
Rachael Dietkus, LCSW
Trauma-Responsive Design: Reimagining the Future of Design Now
2021 • Civic Design 2021
Gold
Scott Plewes
Why Isn't Your UX Approach Going Viral?: A Mathematical Model
2023 • Advancing Research 2023
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Enterprise UX 2023
Gold

More Videos

Elizabeth Sklar

"Our bet was that distributing ownership would create more advocates and free bandwidth for strategic work."

Elizabeth Sklar Jessica Sheng

Co-creating research enablement with your tech org: a case study

March 10, 2026

Saara Kamppari-Miller

"Key is a reminder that these metrics reflect what is authoritative and important to the customer and the business."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Gretchen Anderson

"I see designers fall back on being the defender of the user like a union boss, but that’s not your only responsibility."

Gretchen Anderson

Scaling the Human Center

June 8, 2017

Chelsea Mauldin

"Our team-based costing accounts for changing project roles and time, reflecting true collaborative effort."

Chelsea Mauldin

Let's Talk About Money

November 17, 2022

Lada Gorlenko

"We often talk about our customers, but we forget the other people involved: ourselves and our teams."

Lada Gorlenko

Theme 3: Introduction

June 10, 2021

Craig Villamor

"A style guide is an artifact, but a design system is a living, funded product with a roadmap serving an ecosystem."

Craig Villamor

Resilient Enterprise Design

June 8, 2017

Susan Simon-Daniels

"As a researcher, your brain is shouting, red alert, red alert, there’s some problem I need to find out."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Robin Beers

"Great research doesn’t automatically have the intended impact because people may not want their minds changed."

Robin Beers

Beyond Insights: Researchers as Organizational Change Catalysts

March 25, 2024

Paul Pangaro, PhD

"If you don't have shared language and values, you can't coordinate your actions or agree on what to do."

Paul Pangaro, PhD

Systems Disciplines: Table Stakes for 21st Century Organizations

June 6, 2023