Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Anna Nguyen
Why Our Voice of the Customer is Better Than Yours
2022 • Advancing Research 2022
Gold
Meredith Black
Building Community and Common Trends to Look for in 2021
2020 • DesignOps Community
Satyam Kantamneni
Do You Have an Experience Vision?
2023 • Enterprise Community
Dave Hoffer
UX Job Search AMA #3 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Crystal Philcox
The Many Faces of Operations
2017 • DesignOps Summit 2017
Gold
Jamika Burge
Embracing change: Navigating shifting landscapes with compassion and agency
2025 • Advancing Research 2025
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Silke Bochat
5 Antifragile Strategies for a DesignOps 2.0
2024 • DesignOps Summit 2024
Gold
Christopher Noessel
AI of the now: Designing for Agents
2024 • Rosenfeld Community
Jane Davis
Strategic Shifts and Innovations in User Research: Navigating Challenges and Opportunities
2025 • Advancing Research 2025
Gold
Sarah Brooks
Theme 3 Intro
2021 • Civic Design 2021
Gold
Megan Blocker
Theme 2 Intro
2025 • Advancing Research 2025
Gold
Rachael Dietkus, LCSW
Everything You Need to Know about the Civic Design 2022 Call for Presentations
2022 • Civic Design Community
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community

More Videos

John Cutler

"These aren't linear; every circle or box has multiple lines into it—our work does not fit neatly into trees or pyramids."

John Cutler

The Alignment Trap

November 29, 2023

Samuel Proulx

"Designing for the average means designing for nobody."

Samuel Proulx

From Standards to Innovation: Why Inclusive Design Wins

November 19, 2025

Alastair Simpson

"Research does this and design does that creates an us versus them strategy that leads to needless friction."

Alastair Simpson

Debunking the Myths of Cross-Disciplinary Collaboration

October 24, 2019

Kit Unger

"Her energy and enthusiasm is contagious and she inspires everyone on the team to expand our horizons and go further."

Kit Unger Lada Gorlenko

Theme 3 Intro

June 10, 2022

JD Buckley

"Fight to communicate your passion in a way that is digestible for other people."

JD Buckley Margot Dear Jim Kalbach Janaki Kumar

COMMUNICATE: Discussion

June 14, 2018

Husani Oakley

"This is a journey with no end, and it’s amazing that we can continue the conversation beyond this session."

Husani Oakley

Theme Two Intro

June 6, 2023

Llewyn Paine

"Today’s speakers come from real world companies facing real consequences for their choices about AI."

Llewyn Paine

Day 1 Using AI in UX with Impact

June 10, 2025

Scott Plewes

"You don’t need to be an expert in math to start making connections between math and UX."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023

Mark Interrante

"Prioritization work is a political process, and politics are hard to do in technology."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024