Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • Screen readers allow users to navigate web pages quickly by jumping through well-structured headings and content.

  • Low vision users often rely on system-wide screen magnification and color inversion settings to reduce eye strain.

  • Alternative navigation methods like head mice and voice dictation are selected based on task and user condition, not used exclusively.

  • Traditional lab-based usability research often prioritizes convenience over real assistive technology configurations, leading to inaccurate results.

  • Assistive technology users rarely use default settings; they extensively customize tools over time for optimal use.

  • The System Usability Scale (SUS) includes questions that confuse assistive technology users and do not capture their true experience.

  • Fable’s Accessible Usability Scale adapts SUS questions to better reflect the experience of assistive technology users.

  • Initial data shows screen reader users report significantly lower usability scores (mid-50s) compared to screen magnification users (low 60s).

  • Users’ lowered expectations after years of experience may mask the true severity of usability issues in assistive technology contexts.

  • Measuring accessibility usability accurately enables benchmarking and progress in improving digital products for all users.

Notable Quotes

"I’ve been using screen readers for 30 years and accessibility has always been a passion of mine."

"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."

"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."

"No assistive technology user uses default settings; we spend years customizing everything to work for us."

"The System Usability Scale’s question about needing a technical person to use the system is confusing and inaccurate for screen reader users."

"Most people with my assistive technology might learn to use the system at a different pace than non-disabled users."

"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."

"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."

Ask the Rosenbot
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Bianca Jefferson
From Sprints to Systems: Operationalizing Continuous Discovery Through DesignOps
2025 • DesignOps Summit 2025
Gold
Scott Stephens
The Next Generation in DesignOps Toolsets
2022 • DesignOps Community
Ted Booth
Discussion
2016 • Enterprise UX 2016
Gold
Jilanna Wilson
Distributed Design Operations Management
2019 • DesignOps Summit 2019
Gold
Dan Willis
Filling the Void
2018 • DesignOps Summit 2018
Gold
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
Cheryl Platz
Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing
2024 • Rosenfeld Community
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
Victor Udoewa
Research in the Pluriverse
2023 • Advancing Research 2023
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Civic Design 2022
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Louis Rosenfeld
Becoming a Civic Designer: Making the Move from Private to Public Sector
2022 • Civic Design 2022
Gold
Giff Constable
Financial fluency for product leaders: AMA with Giff Constable
2024 • Rosenfeld Community
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group

More Videos

Shahrzad Samadzadeh

"Some situations are not worth saving. If you have no champion, no clarity, and no purpose, is it worth it to continue?"

Shahrzad Samadzadeh

What Is My Value? Two Takes and Some Mistakes

January 8, 2024

Brenna Fallon

"It matters what you build, but it matters more if you learn."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Ruzanna Rozman

"Frameworks are a team sport; each player brings unique strengths that help create innovative solutions."

Ruzanna Rozman

Getting in Flow with Your Team

January 8, 2024

Sheryl Cababa

"Optimizing something for ease of use does not mean it’s best for humanity — infinite scroll is a cautionary example."

Sheryl Cababa

Expanding your Design Lens with Systems Thinking

March 28, 2023

Melissa Schmidt

"Post-AU, I feared no one would synthesize or share what they learned because everyone got busy and distracted."

Melissa Schmidt Adam Menter

How UX Research Hit It Big in Las Vegas

June 4, 2019

Nathan Curtis

"We get accessibility baked in, so if you use the design system properly, you pretty much guarantee compliance."

Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn Ressel

Discussion

June 9, 2016

Jake Burghardt

"Insight summaries create durable knowledge that only goes away when it's been resolved or no longer relevant."

Jake Burghardt

Stop wasting research: Create new value with insight summaries

July 9, 2025

Kate Towsey

"Synthetic users might be okay for finding average behaviors, but they won’t replace unique insights from real users."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Bria Alexander

"Slack is the heart and soul of this conference — that’s where you ask questions, get help, and connect with others."

Bria Alexander

Opening Remarks

September 9, 2022