Accessibility at Scale
Summary
The outcome of designing at scale won't be accessible products unless accessibility practices scale in parallel with design. There are six primary challenges to scaling accessibility: 1) Reliance on human testing which is especially complicated for large/dynamic products. 2) SaaS/Native app "release whenever you want" timelines. 3) Third party code/content managers. 4) Achieving "substantive WCAG conformance" 5) Closing the feedback loop by getting defects/feature requests from people with disabilities into the backlog. 6) Shifting the focus to an accessible experience, not just an accessible product.
Key Insights
-
•
Accessibility encompasses both visible and invisible disabilities, affecting roughly 30% of users via permanent, temporary, or situational impairments.
-
•
Assistive technologies communicate bidirectionally with software, requiring products to support this interaction cleanly to be accessible.
-
•
WCAG standards are the international source of truth for accessibility, with version 2.1 AA widely mandated and 3.0 on the horizon.
-
•
Automated tools catch about 30% of accessibility issues, machine learning tools currently only about 4%, leaving over half to human validation.
-
•
Making a product accessible initially is straightforward with resources and people; maintaining accessibility over time is far more complex and process-driven.
-
•
Scaling accessibility in cloud and continuous integration environments is challenging due to rapid, frequent software releases.
-
•
Integrating accessibility from the beginning into design, development, and definition of done prevents costly retrofitting later.
-
•
Organizational culture changes including executive buy-in, centralized resources, and accessibility champions are essential for scaling.
-
•
Hiring and retaining employees with disabilities and ensuring all workplace tools and events are accessible fosters inclusion and eases product accessibility efforts.
-
•
Accessibility defects should be treated like any other critical bugs and prioritized accordingly to ensure timely remediation.
Notable Quotes
"Accessibility isn’t just about visible disabilities; it’s about invisible disabilities and situational impairments too."
"Either you need accessibility now or you will need accessibility in the future."
"Assistive technology has to communicate with the destination, that’s your website or product."
"You’re not supposed to sell to the US public sector unless you’re WCAG 2.0 AA compliant."
"Getting something accessible is a straight line; keeping something accessible requires process change."
"Keeping something cloud-based accessible is the most complicated because of hundreds of releases per day in continuous integration."
"Accessibility at scale can put you into the VUCA world – volatile, uncertain, complex, ambiguous."
"You want to catch accessibility defects early through automated testing in your CI/CD pipeline, what we call shifting left."
"If you’re rewarding designers for delivering on time, great, but if you reward them for delivering accessible products on time, you’ll get better results."
"Accessibility defects are bugs. If it’s a P1 blocking bug for an accessibility issue, treat it like any other P1 bug."
Or choose a question:
More Videos
"When you’re doing a survey, think about if it can be done in a way that is much more accessible."
Samuel MartinCo-Design vs Faux-Design: Navigating the Complexities of Sharing Power in Co-Design
March 27, 2026
"I’m excited about scaling our research work with better ops support and building tools to share knowledge more efficiently."
Kayla Farrell Chelsey Glasson Sean Fitzell Jared LeClercWhat It's Like To Be a User Researcher at Compass
March 12, 2021
"If your users are happy, that anecdotal feedback often carries more weight early than quantitative metrics."
Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne RogondinoTheme 1: Discussion
January 8, 2024
"With User Interviews, you can launch a project immediately and get your first qualified participant as fast as three hours."
Lily Aduana Savannah Hobbs Brittany Rutherford5 Reasons to Bring Your Recruiting in-House (and How To Do It)
March 12, 2021
"Having leadership involved early with demos and feedback helps smooth the path to adopting a knowledge repository tool."
Tony TurnerCapturing Deep Insights
September 30, 2021
"Building an emergency backup process ensured research would continue even if key Ops people were unavailable."
Marjorie Stainback Molly Fargotstein Stephanie MarshWhat Research Ops Professionals Have Learned from COVID-19
July 16, 2020
"We use Zoom waiting rooms to anonymize observers and create space for private consent conversations."
Theresa MarwahHow Atlassian is Operationalizing Respect in Research
February 27, 2020
"We have four themes over two days: systems thinking, information architecture and knowledge management, AI and machine learning, and designing the data."
Louis RosenfeldWelcome / Housekeeping
June 7, 2023
"There's quantitative, qualitative, generative, evaluative data and methods like AB testing—it can be overwhelming."
Uday GajendarTheme Four Intro
June 6, 2023