This video is featured in the AI and UX playlist and 1 more.
Summary
We’re moving into a future of widespread deployment of AI. Skate where the puck is going: what new design paradigms will we need for our new products there? To explore this, Matt starts practically… with his own prototypes and experiments. He finds five possible worlds, and we’ll imagine each in turn, finally asking: what does it mean to dream?
Key Insights
-
•
A large language model can power surprisingly intelligent agents with minimal code, enabling multi-step problem solving without explicit programming.
-
•
Hallucinations in AI, often seen negatively, are a form of AI creativity crucial for invention, fiction, and new ideas.
-
•
AI-assisted development lowers barriers, making complex engineering tasks like iOS app creation accessible to non-experts through incremental prompting.
-
•
Mini apps tailored for single users or niche tasks are becoming feasible due to AI prompting, creating a challenge for discovery and trust management.
-
•
Interfaces powered by AI agents will evolve to be adaptive and collaborative, blending human and non-human participants in workflows.
-
•
Emergent behaviors from simple agent frameworks can include awareness, tool usage, and asking for human input when needed.
-
•
AI’s sudden computational leap is equivalent to a decade of progress overnight, radically accelerating creative and practical workflows.
-
•
Distinct AI personalities or agent identities help users understand capabilities and maintain a theory of mind for complex systems.
-
•
AI ubiquity implies intelligence will be cheap and embedded in everyday products, not reserved for high-end applications.
-
•
Generative AI offers not only incremental improvements but opportunities to dream up entirely new kinds of experiences and products.
Notable Quotes
"What makes it different is that it doesn’t run sequentially; you give it a goal and it decides how to achieve it."
"It’s actually embarrassing how little code there is and you get these incredible emergent effects."
"Computers got ten years better overnight with the arrival of GPT-3 in November 2022."
"Mini apps might not be useful for you, but they are for someone, and now those people can have them."
"Our existing software is becoming adaptive, allowing end users to vibe code features themselves."
"Hallucinations are a kind of AI creativity—dreaming, invention, fiction—all forms of hallucination."
"The black Buzz Rickson jacket came from a work of fiction by William Gibson and then was made real."
"AI intelligence is too cheap to meter, or we can call it McKinsey interns too cheap to meter."
"The challenge is how do we relate to AI interfaces, because surely it isn’t just this chat-based loop."
"We can make our dreams real, bringing objects back from the other side of the bridge."
Or choose a question:
More Videos
"Trying something new can feel very daunting, especially if you rarely interact with people who use assistive technology."
Kavana RameshMeaningful inclusion: Practicing accessibility research with confidence
September 24, 2024
"UX assets are our business assets."
Rima Campbell Amrit S BhachuIncrease Productivity and Drive Business Impact
September 24, 2024
"Sponsors believe in advancing research, and we wouldn’t be here without them."
Bria Alexander Louis RosenfeldOpening Remarks Day 1
March 25, 2024
"I don’t want people to do a 6 AM call — I can do a 10 PM call to brainstorm but not a design critique."
Kim LenoxLeading Distributed Global Teams
May 20, 2019
"The Rosenverse is a weird mix: it’s a for-profit business but also a neutral community resource."
Louis RosenfeldThe Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
June 5, 2024
"Corporate capture of research has brought amazing good things but changed the truth to power role."
Steve PortigalLooking Back…to Look Ahead
March 26, 2024
"Do not judge me by my success, judge me by how many times I fell down and got back up again."
Maggie DieringerCreating Consistency Through Constant Change
January 8, 2024
"There’s a tension in repositories having to serve immediate product decisions and more durable, strategic knowledge."
Brigette Metzler Dana ChrisfieldResearch Repositories: A global project by the ResearchOps Community
August 27, 2020
"Most of the work on accessible prototyping for screen readers is still in early or mid research stages but is improving rapidly."
Sam ProulxPrototype Reviews, People With Disabilities, and You
October 1, 2021
Latest Books All books
Dig deeper with the Rosenbot
How can teams integrate inclusive design into early product development stages to avoid costly late fixes?
How can ethnographic storytelling contribute to making systems visible in organizations?
What mindset shifts are needed to work effectively with complexity instead of trying to simplify or control it?