Summary
AI-enabled systems that are responsible and human-centered, will be powerful partners to humans. Making systems that people are willing to be responsible for, and that are trustworthy to those using them enables that partnership. Carol will share guidance for operationalizing the work of making responsible human-centered AI systems based on UX research. She will share methods for UX teams to support bias identification, prevent harm, and support human-machine teaming through design of appropriate evidence of system capabilities and integrity through interaction design. Once these dynamic systems are out in the world, critical oversight activities are needed for AI systems to continue to be effective. This session will introduce each of these complex topics and provide references for further exploration of these exciting issues.
Key Insights
-
•
Responsible AI systems must keep humans in control and prioritize user experience.
-
•
Human and machine teaming should be designed with transparency and mutual understanding in mind.
-
•
AI systems are only as good as the data they are trained on; bias in data must be recognized and mitigated.
-
•
Continuous oversight of AI systems is necessary to adapt to changing data and environments.
-
•
Human strengths should be prioritized, as there are still many areas where humans outperform AI.
-
•
Speculative design can help anticipate potential harms and prevent them before they occur.
-
•
Inclusive design practices should actively consider and aim to reduce disparities affecting marginalized groups.
-
•
Technical ethics should guide all teams in making decisions about AI systems.
-
•
Usability testing is crucial for uncovering vulnerabilities in AI interactions.
-
•
The design process must include explicit responsibilities for both humans and AI systems.
Notable Quotes
"Responsible systems are designed to work with and for people, providing trustworthy interactions."
"Data is not inherently neutral; it reflects the priorities and prejudices of those who create it."
"Making responsible human-centered AI involves understanding complexity, human-machine teaming, and continuous oversight."
"Speculation is key to keeping people safe and anticipating the non-obvious consequences of AI deployment."
"All systems have a form of bias due to the information curated by humans, and we must acknowledge this."
"AI systems must always be supervised by humans, who retain ultimate responsibility for decisions involved."
"Trust cannot be measured easily, as it is deeply personal and complex."
"Unplugging machines and maintaining ultimate human control is vital in AI system design."
"It’s crucial to design actions that lead to safe states to be easy, while unsafe actions should be harder to execute."
"Ethical design isn’t superficial; it requires deep inquiry into implications and societal impact."
More Videos
"How can we put a chatbot in the product instead of only at the end of the process?"
Noz UrbinaRapid AI-powered UX (RAUX): A framework for empowering human designers
May 1, 2025
"There are guidelines that we rely on to help us stay together."
Jim KalbachJazz Improvisation as a Model for Team Collaboration
June 4, 2019
"I still do this today. I make a service map when I know I need to grow a team fast."
Holly ColeUnderstanding Experiences: When you have to do more than work
November 8, 2018
"Working with coded components closes the loop of documentation and empowers stakeholders."
Jack BeharHow to Build Prototypes that Behave like an End-Product
December 6, 2022
"It is very important for us to keep the vibes positive and make sure you feel good about being here."
Bria AlexanderOpening Remarks
October 3, 2023
"Organizations must build a culture of safe experimentation and reward curiosity."
Erika FlowersAI-Readiness: Preparing NASA for a Data-Driven, Agile Future
June 10, 2025
"Teachers need actionable insights, not just raw data."
Kristin SkinnerFive Years of DesignOps
September 29, 2021
"The soloist has to begin at the start of the form and end at the end of that form."
Jim KalbachJazz Improvisation as a Model for Team Collaboration
November 6, 2017
"Think in systems to scale creative initiatives effectively."
Surya VankaUnleashing Swarm Creativity to Solve Enterprise Challenges
June 10, 2021
