Augment the Human. Interrogate the System.
Summary
Key Insights
-
•
Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.
-
•
Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.
-
•
Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.
-
•
The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.
-
•
Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.
-
•
Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.
-
•
Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.
-
•
Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.
-
•
Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.
-
•
Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.
Notable Quotes
"Designers need data, but data also needs designers."
"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."
"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."
"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."
"Trust erodes very quickly the moment an AI prediction is a little off or wrong."
"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."
"Working with AI is a lot less like working with another human and more like working with some weird force of nature."
"AI has no understanding of consequences — humans are the ones to bring that understanding."
"The relationship between designers and data scientists can actually be pretty magical."
"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."
Or choose a question:
More Videos
"Listen for the 10% truth in difficult people's words and build on that."
Tutti TaygerlyVideconference: How to Work with Difficult People with Tutti Taygerly
June 25, 2020
"Not every Design Ops person is the same, and Design Ops is going to look very different at every company."
Dave Malouf Meredith Black Farid SabitovThe Past, Present, and Future of DesignOps: a 2-part DesignOps Community Call (Part 1)
February 17, 2022
"We’re not trying to change behavior, but help researchers in their existing processes to make research faster."
Kate Towsey Basel Fakhoury Oren Friedman Graham GardnerParticipant Recruitment and Management Tools
March 12, 2026
"What if design ops’ job was to condition the environment and remove friction?"
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018
"People are re-evaluating their lives and careers, which inspired me to start a podcast exploring these shifts."
Bria Alexander Meredith Black Tim GilliganState of DesignOps Panel
October 1, 2021
"Users immediately assumed that a single identity meant our products would work together naturally, even before we proposed product connectivity."
Dawn ResselFull-Stack User Experiences: A Marriage of Design and Technology
June 9, 2016
"The V2MOM stands for Vision, Values, Methods, Obstacles, and Measures and is a framework every Salesforce employee uses."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"Being intentional about how we spend our time is the purest manifestation of our values and our value."
Liam ThurstonWhy Your Design Team Is Quitting, And How To Fix It
June 10, 2022
"We are in the process of growing and maturing the design system before we open it to the public."
Bob Baxley Sara Asche Anderson Sharon Bautista Frank Duran Jamie Kaspszak Abbey Smalley Sylas SouzaTheme 4: Discussion
January 8, 2024