Research in the Automated Future
Summary
Key Insights
-
•
Design and research are tightly intertwined; it's often impossible to tell where one ends and the other begins.
-
•
Machine learning models primarily predict based on past data rather than interact dynamically with the environment.
-
•
Intelligent systems involve multi-agency contexts where both humans and machines have decision-making power.
-
•
Unlike static software, AI systems are dynamic, learning and evolving based on interactions and data.
-
•
Design research for AI must be future-focused and speculative, addressing not just usability but cultural values and trust.
-
•
Bias in AI is complex, involving mathematical, statistical, cognitive, and human biases requiring nuanced mitigation.
-
•
Researchers and designers need high AI and data literacy to influence data inputs and model fairness, not just outputs.
-
•
Explainability in AI is challenging, especially with neural networks, necessitating governance and 'glass box' approaches.
-
•
Design anthropology and participatory methods help uncover unspoken human practices important for automated systems.
-
•
Speculative prototypes (provocation prototypes) and perpetual synthesis support ongoing learning about future AI use.
Notable Quotes
"Design is the conscious and intuitive effort to impose meaningful order to chaos."
"Our role as designers and researchers will be to determine what not to design to preserve human culture and values."
"Machine learning models can see, hear, think, and act but are limited to problem-solving based on past observations."
"The relationship between a user and AI system is multi-agency; both have agency to act and influence outcomes."
"The nuance is the enemy of machine learning and AI; they struggle with ambiguity where humans thrive."
"Research for AI must go beyond single agency frameworks to consider complex ecosystems and multi-modal environments."
"It's not about looking under the hood of the model, but about what data goes into the hood that you can influence."
"There are many types of bias—mathematical, statistical, cognitive, human—and they affect AI outcomes differently."
"Explainability requires transparency at every stage with governance ensuring fairness and equity in model building."
"Speculative research requires participatory methods, putting people into future scenarios, because people often can't articulate what they will want."
Or choose a question:
More Videos
"The trusted partnership between the chief of staff and the executive is critically important."
Isaac HeyveldExpand DesignOps Leadership as a Chief of Staff
September 8, 2022
"Trust the user and trust the model are the two lessons I’m getting over time."
Peter Van DijckHands on AI #3: Claude Code for UX people
October 22, 2025
"The higher up you are in an organization, the more distorted your reality is likely to be."
Dave GrayLiminal Thinking: Sense-making for systems in large organizations
May 14, 2015
"If we are designing experiences that don’t work for everyone today, we’re designing experiences that in a couple of years will exclude ourselves."
Sam ProulxAccessibility: An Opportunity to Innovate
June 8, 2022
"Service design blueprints help visualize gaps where design has impact but not influence."
Wendy JohanssonAn Education on Design Education for Orgs
June 10, 2021
"Enterprise is kind of sexy because big, hairy, hard problems of scale and distribution live at the enterprise."
Bria Alexander Louis RosenfeldWelcome
January 8, 2024
"There’s been a steady evolution starting with delivering buildings to delivering national economic visions."
Stephen PollardClosing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
November 7, 2017
"Affordances seem to have fallen to the wayside in favor of flat design and revenue optimization."
Uday Gajendar Adam RichardsonFrom AI to Zeitgeist: Theory as the design antidote to AI hype
March 27, 2025
"The pandemic is reminding me of the positive and powerful force digital can play when we really need it most."
Leah BuleyClosing Plenary: The Crisis of Digital
March 31, 2020