Rosenverse
Augment the Human. Interrogate the System.

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Irina Tikhonova
Small Wins, Big Impact: Leveraging and Elevating User Engagement
2021 • Civic Design 2021
Gold
Alexandra Schmidt
Why Ethics Can't Save Tech
2022 • Civic Design 2022
Gold
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Jake Burghardt
Stop wasting research: Create new value with insight summaries
2025 • Rosenfeld Community
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
George Abraham
Design Systems To-Go: Introducing a Starter Design System, and Indigo.Design Overview (Part 1)
2021 • DesignOps Summit 2021
Gold
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
John Cutler
The Alignment Trap
2023 • Design in Product 2023
Gold
Victor Lombardi
Bridging Design and Climate Science
2024 • Climate UX Interest Group
Taylor Klassman
The Evolution of UX Research Platforms
2026 • Advancing Research 2026
Gold
Jacqui Frey
Flow and Superfluidity for Design Orgs
2018 • DesignOps Summit 2018
Gold
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Nicole Umphress
Delivering Design Education During a Global Pandemic: Lessons Learned
2022 • Design at Scale 2022
Gold
Victor Udoewa
Research in the Pluriverse
2023 • Advancing Research 2023
Gold
Dalia El-Shimy
So You've Got a Seat at the Table. Now What?
2020 • Advancing Research 2020
Gold

More Videos

Victor Udoewa

"Songs become methodologies—the way you identify who is at the door is through the song they sing."

Victor Udoewa

Beyond Methods and Diversity: The Roots of Inclusion

March 26, 2024

Nalini Kotamraju

"Our shift is structural, not because of personalities — it was needed to influence earlier, more business-centric decisions."

Nalini Kotamraju

Research After UX

March 25, 2024

Aiyana Bodi

"Finding your people inside an organization and being brave together is a great first step to climate action."

Aiyana Bodi James Christie Marc O'Brien Louis Rosenfeld

Three Key Climate Initiatives and How You Can Help

September 11, 2024

Catherine Dubut

"The store mobile device is the indispensable silent partner enabling store employees to balance task productivity and customer engagement."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Uday Gajendar

"There are professional standards and human standards in place; we need to treat each other kindly."

Uday Gajendar Louis Rosenfeld

Day 1 Welcome

June 4, 2024

Uday Gajendar

"Affordances seem to have fallen to the wayside in favor of flat design and revenue optimization."

Uday Gajendar Adam Richardson

From AI to Zeitgeist: Theory as the design antidote to AI hype

March 27, 2025

Dave Malouf

"How can we find the natural paths that connect myself, my team’s intention, and my business’s intention?"

Dave Malouf

Theme 3: Introduction and Provocation

January 8, 2024

Kate Towsey

"People don't learn when they're rushed, stressed, or don't trust the source of the knowledge."

Kate Towsey

Ask Me Anything (AMA) with Kate Towsey

April 2, 2025

Milan Guenther

"Scaffolding is like the wireframe in the physical world, it’s what we do just enough of to push the experience forward and challenge constraints."

Milan Guenther Benjamin Kumpf

The $212 billion ‘so what?’: unlocking impact in development cooperation

November 20, 2025