Designing inclusively with AI
Summary
Key Insights
-
•
AI-generated images of people with disabilities often show racial and representation biases, such as all-white subjects and inaccurate assistive device depictions.
-
•
Disability representation in AI images is frequently inaccurate, e.g., guide dogs shown with leashes instead of harnesses and blindfolds over eyes.
-
•
AI-generated personas for users with disabilities can contain improbable feature combinations, such as a MacBook user reliant on Windows-only assistive tech like JAWS.
-
•
Personas created by AI lack the depth and nuance gained from real user research and testing, especially for disability accessibility considerations.
-
•
AI-generated mockups can have accessibility issues like poor contrast and unlabeled UI elements, requiring human accessibility review.
-
•
AI tools like Stark Sidekick improve design accessibility through automated issue detection, though they are not yet full replacements for experts.
-
•
AI-powered task management apps can enhance productivity and accommodation for neurodivergent users by organizing schedules and reducing cognitive load.
-
•
AI can help identify potential biases in accessibility automation projects, but requires careful prompt crafting and domain expertise.
-
•
Designing AI-powered interfaces comes with inclusion challenges, as users unfamiliar with prompting may struggle to get effective results.
-
•
Combining AI output with continuous user testing, especially involving people with disabilities, is essential to ensure accessibility and inclusion.
Notable Quotes
"If you have questions, I will take questions throughout."
"AI-generated images often have no racial diversity and show inaccurate assistive device representation."
"You are either navigating with a white cane or a service dog because you are not gonna want both of your hands full."
"Personas tend to not give you those deep insights that you would get from user research and user testing."
"Automation might not be able to capture the context of an image if you're trying to describe an image."
"AI is actually a pretty good productivity hack as a starting point for accessibility reviews."
"A lot of people will try a prompt and not get what they were hoping to get and maybe miss out on all the benefits of AI."
"For people who identify as autistic, AI tools that review writing tone can be especially helpful."
"If the code doesn’t match the label on screen, voice controls might not recognize the command."
"There always has to be a human option if you’re not getting what you need from the AI."
Or choose a question:
More Videos
"As the product journey progressed, research cadence got faster with prototypes and quicker feedback loops."
Dr Chloe SharpUsing Evidence and Collaboration for Setting and Defending Priorities
November 29, 2023
"If you value innovation and design, then you're investing in creativity."
Dr. Karl JeffriesThe Science of Creativity for DesignOps
January 8, 2024
"AI should remain a tool, not a standalone solution, in inclusive product development."
Amber KnablEmpowering innovation: The critical role of inclusive product development in the AI era
June 4, 2024
"Feedback isn’t about liking. Helpful feedback needs to be, is this solving your problem or not."
Dorelle RabinowitzThe Magic Word is Trust
June 15, 2018
"In a fight, there’s a winner and a loser. But for a product to be successful, it has to work both for users and business."
Dan WillisEnterprise Storytelling Sessions
June 3, 2019
"We created onboarding camps that helped new hires become impactful faster and packaged that across teams."
Courtney KaplanTaking it to the next level: Career paths in DesignOps
November 8, 2018
"I spent 40% of my day verifying what the system already knows."
Bethany BrownRewiring operations with service design and AI
November 20, 2025
"Well-set-up AI systems pulling data from multiple company sources will have more context, but it’s still limited compared to human understanding."
Laura KleinHuman vs. machine: Testing AI’s ability to synthesize and analyze research
March 11, 2026
"AI can’t experience data subjectively or fulfill curiosity, which drives human insight and discovery in qualitative research."
Weidan LiQualitative synthesis with ChatGPT: Better or worse than human intelligence?
June 4, 2024
Latest Books All books
Dig deeper with the Rosenbot
What are effective use cases for AI in prototyping UI interactions according to senior designers?
How did separation of content and design benefit web accessibility and future-proofing?
Why is it expensive and complicated to design AI-powered UX across different platforms like Slack, Teams, and Claude?