Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Mike Oren
Why Pharmaceutical's Research Model Should Replace Design Thinking
2023 • Advancing Research 2023
Gold
Michael Weir
Mixed Methods and Behavioural Science
2023 • Rosenfeld Community
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
Caroline Jarrett
Have fun with statistics?
2024 • Rosenfeld Community
Megan Kierstead
You Are a Badass at UX: Overcoming Imposter Syndrome
2021 • Advancing Research 2021
Gold
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group
Mark Boulton
Ops without Designers
2018 • DesignOps Summit 2018
Gold
Kaitlin Tasker
Fast and Fearless Inclusive Research
2023 • Advancing Research 2023
Gold
Eduardo Ortiz
Theme 3 Intro
2025 • Advancing Research 2025
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Cheryl Platz
Merging Improv with Design
2019 • Enterprise Community

More Videos

Christian Crumlish

"When something good happens, I want to name the person who did it and say yes, they passed through me. When something bad happens, I say let me and my team go look into it."

Christian Crumlish Wendy Johansson Rich Mironov Aditi Ruiz Adam Thomas

Afternoon Insights Panel

December 6, 2022

Michael Land

"The biggest bottleneck is the bureaucracy, like the Paperwork Reduction Act, we have to creatively navigate that."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Bria Alexander

"You bring energy that blows me away. I’m so excited by your excitement."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Surya Vanka

"Visual process maps embody cognition and allow people to step through design without becoming experts."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Cassandra Piester

"You want to get really deep in the weeds with one team first, then move into a facilitation role to scale across teams."

Cassandra Piester

Developing and Deploying Your Design Operations Strategy

September 24, 2024

Ariel Kennan

"Yesterday we saw themes emerge on striving for inclusion, applying equity and sustaining the work over time."

Ariel Kennan

Theme 2 Intro

December 9, 2021

Joshua Graves

"Establishing a shared vision with your boss or team helps align goals, even amid conflict."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Peter Van Dijck

"All the complicated-sounding techniques are just ways to put the relevant text into the context window."

Peter Van Dijck

Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!

July 30, 2025

Bria Alexander

"Our dedicated scribe Shivangi is making sure all the notes are captured so you don't have to worry about it."

Bria Alexander

Opening Remarks

November 17, 2022