Designing inclusively with AI
Summary
We know there’s massive opportunity for AI to be used for greater speed, growth, and insights, but how can we avoid the pitfalls? Head of Accessibility Innovation at Fable Kate Kalcevich will share how to best leverage current AI tools in your day-to-day work with inclusion in mind.
Key Insights
-
•
AI-generated images of people with disabilities often show racial and representation biases, such as all-white subjects and inaccurate assistive device depictions.
-
•
Disability representation in AI images is frequently inaccurate, e.g., guide dogs shown with leashes instead of harnesses and blindfolds over eyes.
-
•
AI-generated personas for users with disabilities can contain improbable feature combinations, such as a MacBook user reliant on Windows-only assistive tech like JAWS.
-
•
Personas created by AI lack the depth and nuance gained from real user research and testing, especially for disability accessibility considerations.
-
•
AI-generated mockups can have accessibility issues like poor contrast and unlabeled UI elements, requiring human accessibility review.
-
•
AI tools like Stark Sidekick improve design accessibility through automated issue detection, though they are not yet full replacements for experts.
-
•
AI-powered task management apps can enhance productivity and accommodation for neurodivergent users by organizing schedules and reducing cognitive load.
-
•
AI can help identify potential biases in accessibility automation projects, but requires careful prompt crafting and domain expertise.
-
•
Designing AI-powered interfaces comes with inclusion challenges, as users unfamiliar with prompting may struggle to get effective results.
-
•
Combining AI output with continuous user testing, especially involving people with disabilities, is essential to ensure accessibility and inclusion.
Notable Quotes
"If you have questions, I will take questions throughout."
"AI-generated images often have no racial diversity and show inaccurate assistive device representation."
"You are either navigating with a white cane or a service dog because you are not gonna want both of your hands full."
"Personas tend to not give you those deep insights that you would get from user research and user testing."
"Automation might not be able to capture the context of an image if you're trying to describe an image."
"AI is actually a pretty good productivity hack as a starting point for accessibility reviews."
"A lot of people will try a prompt and not get what they were hoping to get and maybe miss out on all the benefits of AI."
"For people who identify as autistic, AI tools that review writing tone can be especially helpful."
"If the code doesn’t match the label on screen, voice controls might not recognize the command."
"There always has to be a human option if you’re not getting what you need from the AI."
Or choose a question:
More Videos
"We’re all capable of creating and perpetuating toxic work relationships."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
"Friction in a situation can cause a person to switch thinking styles, not personality types."
Indi YoungThinking styles: Mend hidden cracks in your market
January 8, 2025
"This is a great opportunity. This is a gift to yourself to dig in with other design ops peers and really learn together."
Louis Rosenfeld Bria AlexanderDay 1 Welcome
September 23, 2024
"Customer understanding gives teams focus. Customer empathy gives purpose."
Melissa Schmidt Adam MenterHow UX Research Hit It Big in Las Vegas
June 4, 2019
"Designers often resist processes meant to streamline their work because it feels restrictive."
Kristin Skinner Kamdyn Moore8 Types of Measures in Design Operations
April 16, 2020
"If you’re the first researcher, you will often encounter organizational inertia, and the key is to find a partner team and succeed there first."
Dave HoraAdvice for Establishing Research
December 8, 2022
"As we grow, it becomes difficult for everyone to deeply engage with research or remain close to users."
Sean Fitzell Sarah Han Kayla FarrellCraft of User Research: Building Out Jobs to be Done Maps
March 12, 2021
"Design leadership responsibilities aren’t just for leaders; many overlap with design ops and individual designers."
Jason MesutShaping design, designers and teams
November 8, 2018
"Only 12% of employees strongly agree their organization does a great job onboarding new employees."
Dante GuintuHow to Crush the Talent Crunch
September 8, 2022
