Rosenverse
Augment the Human. Interrogate the System.

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Tricia Wang
The most popular design thinking strategy is BS
2022 • Enterprise Community
Paul Bakaus
Killing the handoff: Iterating design live in the browser on real production code
2026 • Designing with AI 2026
Conference
James Wieselman Schulman
Research is a team sport: advancing the work when everyone does the research
2026 • Advancing Research 2026
Gold
Cassini Nazir
The Dangers of Empathy: Toward More Responsible Design Research
2023 • Advancing Research 2023
Gold
Marc Rettig
Discussion
2015 • Enterprise UX 2015
Gold
Michael Land
Establishing Design Operations in Government
2021 • DesignOps Community
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • DesignOps Summit 2025
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
David Sternberg
Uncovering the hidden forces shaping user behavior
2025 • Rosenfeld Community
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Laura Klein
Human vs. machine: Testing AI’s ability to synthesize and analyze research
2026 • Advancing Research 2026
Gold
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community
Kara Kane
Theme One Intro
2022 • Civic Design 2022
Gold
Tricia Wang
Spatial Collapse: Designing for Emergent Culture
2024 • Enterprise Experience 2020
Gold
Christian Bason
Expand—Rethinking Design for Public Challenges
2022 • Civic Design Community
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold

More Videos

Bria Alexander

"This is our third and final day of the design operation Summit 2021."

Bria Alexander

Opening Remarks

October 1, 2021

Nancy Douyon

"We Westerners are designing for ourselves without realizing it, feeding back into a loop of luxury products."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Tatyana Mamut

"Are we truly a customer-first company, or a shareholder-first company? That shows up in what we measure."

Tatyana Mamut

Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart

June 3, 2019

Vanessa Varin

"Everyone is learning and evolving right now; they just need language and frameworks to name what they’re growing."

Vanessa Varin

Tools are moments. Capabilities compound.

June 9, 2026

Marc Rettig

"Social patterns are established, change-resistant patterns that emerge from the interactions between people."

Marc Rettig

The Urge to Migrate

June 4, 2026

Terry Buckman

"In our war games, persona-like emulations represent groups or leadership apparatus, not just single individuals."

Terry Buckman

Wargaming (An Introduction)

August 10, 2023

Allan Lowson

"Showing a clickable prototype beats still wireframes and style guides where people have to copy hex codes."

Allan Lowson

Rehashing the Double Diamond: Collaborating across functions with AI-assisted prototyping

June 9, 2026

Surya Vanka

"The purpose of design is not to celebrate a solo genius, but to help create a just and equitable world for everyone."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Leisa Reichelt

"At DTA, distributed teams and lack of local diversity meant everyone was out in the field a lot to get diverse input."

Leisa Reichelt

Opening Keynote: Operating in Context

November 7, 2018