Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Llewyn Paine
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
2025 • Advancing Research 2025
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
John Maeda
About Design Organizations
2019 • DesignOps Community
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge
2019 • Advancing Research Community
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
John Maeda
Making Sense of Enterprise UX
2016 • Enterprise UX 2016
Gold
Francesca Barrientos, PhD
You Need Your Own Definition of Design Maturity
2022 • Design at Scale 2022
Gold
Natalie Dunbar
DesignOps and Content Strategy: Envisioning the Future Together
2021 • DesignOps Summit 2021
Gold
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Sam Proulx
Everything You Ever Wanted to Know About Screen Readers
2021 • Design at Scale 2021
Gold
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community
Laureen Kattan
Centering Patients and Clinicians in a Complex Government Ecosystem
2023 • Design in Product 2023
Gold

More Videos

Robin Beers

"A metaphor is like a flashlight—it shines on some things and keeps others in the dark."

Robin Beers

Navigating organizational systems: Rethinking researcher’s role in driving change

March 13, 2025

Laura Schaefer

"Accessibility was viewed as a check mark, a thing to do and check off the list, not as a way of doing things."

Laura Schaefer

DesignOps: A Conduit for Inclusion

September 9, 2022

Ned Gartside

"We need to have a planet before we can have dignity, and sustainability and accessibility are tied basic human rights."

Ned Gartside Mike Gifford Zoe Lopez-Latorre Tzviya Siegman

Navigating accessibility and climate

April 17, 2024

Peter Van Dijck

"Everything’s changing really quickly—if you don’t revise your plan in a few months, you’re building for a world that’s already outdated."

Peter Van Dijck

Designing AI-first products on top of a rapidly evolving technology

June 10, 2025

Surya Vanka

"Swarm behaviors thrive on incomplete information and require no spectators, only participants."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Jemma Ahmed

"Market researchers are turning to lean methodologies that feel very close to what user researchers do."

Jemma Ahmed

Convergent Research Techniques in Customer Journey Mapping

March 31, 2020

"Many hiring managers feel stuck by bureaucracy and policies that haven’t adapted, limiting candidate pools to specific locations."

DesignOps and The Great Talent War of 2021

August 19, 2021

Robin Beers

"Great research doesn’t automatically have the intended impact because people may not want their minds changed."

Robin Beers

Beyond Insights: Researchers as Organizational Change Catalysts

March 25, 2024

Maria Skaaden

"We pick our battles and show what a great party it is without worrying about pulling everyone in."

Maria Skaaden

Panel Discussion: Methodologies and Work Environments

November 8, 2018