Summary
Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?
Key Insights
-
•
Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.
-
•
Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.
-
•
Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.
-
•
The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.
-
•
Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.
-
•
Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.
-
•
Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.
-
•
Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.
-
•
Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.
-
•
Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.
Notable Quotes
"Designers need data, but data also needs designers."
"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."
"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."
"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."
"Trust erodes very quickly the moment an AI prediction is a little off or wrong."
"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."
"Working with AI is a lot less like working with another human and more like working with some weird force of nature."
"AI has no understanding of consequences — humans are the ones to bring that understanding."
"The relationship between designers and data scientists can actually be pretty magical."
"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."
Dig deeper—ask the Rosenbot:















More Videos

"Designers often come out of schools without ever doing competitive analysis or considering existing design patterns."
Kit Unger Jackie Ho Veevi Rosenstein Vasileios XanthopoulosTheme 2: Discussion
January 8, 2024

"Optimizing something for ease of use does not mean best for the user or humanity."
Sheryl CababaLiving in the Clouds: Adopting a Systems Thinking Mindset
June 6, 2023

"If you want to prove someone wrong, you’re actually not seeing the person in front of you."
Lin NieWhen Thought-worlds Collide: Collaborating Between Research and Practice
March 10, 2021

"Research ops folks have a bird’s eye view, seeing methods and quality across projects that others miss."
Fatimah RichmondThe Future of ReOps as a Strategic Function: A Roadmap for Getting There
March 25, 2024

"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Michaela MoraAdvanced Concept Testing Approaches To Guide Product Development and Business Decisions
March 11, 2022

"Even offering an 'other' category in gender questions implies the participant deviates from a presumed norm."
Matt Bernius Rachael Dietkus, LCSW Aditi Joshi Alba VillamilLearnings from Applying Trauma-Informed Principles to the Research Process
March 10, 2022

"Templates don’t have to be masterpieces; even simple reusable checklists and diagrams can save time and effort."
Michelle ChinThe DesignOps Starter Kit
September 29, 2021

"Screen reader users scored in the low to mid 50s on our scale while magnification users scored around 70 and alternative navigation users around 60."
Sam ProulxSUS: A System Unusable for Twenty Percent of the Population
September 29, 2021

"Safety is your number one concern, privacy is your number two, and usability is number three."
Daniel J. RosenbergDigital Medicine Design
September 26, 2019