Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Amy Jiménez Márquez
The Atypical UX Manager Path
2020 • Enterprise Community
Anna Avrekh
User Research, Design, and Product - A Love Story
2021 • Advancing Research 2021
Gold
Kurdin Bazaz
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Matt Bernius
Trauma-informed Research: A Panel Discussion
2021 • Advancing Research Community
Melissa Tsang
From Insights to Action: Driving Business Values through DesignOps
2024 • DesignOps Summit 2020
Gold
Nathan Curtis
Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough?
2019 • DesignOps Community
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Patrick Boehler
Fishing for Real Needs: Reimagining Journalism Needs with AI
2025 • Designing with AI 2025
Gold
Verónica Urzúa
The B-side of the Research Impact
2021 • Advancing Research 2021
Gold
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Michele Wong
Helping Them Help Us
2024 • Enterprise Experience 2020
Gold
Darian Davis
Lessons from a Toxic Work Relationship
2024 • Enterprise Experience 2020
Gold
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
Lais de Almeida
Designing Data Services
2024 • Advancing Service Design 2024
Gold
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold

More Videos

Erin May

"Two researchers can’t come close to digging into the customer problems for 17 product teams."

Erin May Roberta Dombrowski Laura Oxenfeld Brooke Hinton

Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org

March 10, 2022

Sarah Sgarlato Pierini

"We simply told leadership we don’t even know what we don’t know or what we do know, leading to a research insights repository."

Sarah Sgarlato Pierini Kevin Newton

From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn

September 9, 2022

Lada Gorlenko

"Building design communities in legacy companies means bringing other disciplines into the fold."

Lada Gorlenko

Theme 3: Introduction

June 10, 2021

Chris Geison

"For execs, sometimes getting them to be pilot participants makes them feel the product pain and opens them to research."

Chris Geison Cristen Torrey Eric Mahlstedt

What is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question

March 4, 2021

Natalie Dunbar

"Establish success measures that show how content strategy contributes to design ops beyond individual projects."

Natalie Dunbar

DesignOps and Content Strategy: Envisioning the Future Together

October 1, 2021

Dean Broadley

"When crabs shed their shells, they're vulnerable, so they gather in safe groups for protection."

Dean Broadley

Not Black Enough to be White

January 8, 2024

Carol Scott

"If you don't have good usability to begin with, being trauma-informed is not going to work out."

Carol Scott Melissa Eggleston

Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices

February 5, 2025

Louis Rosenfeld

"We want you to take all AI-generated info with a grain of salt but it gets you part of the way."

Louis Rosenfeld Peter Van Dijck

GenAI for UXers: A Rosenbot Demo and Discussion

September 11, 2025

Matt Bernius

"Leadership modeling of vulnerability and human challenges is the first step towards trauma-informed organizational culture."

Matt Bernius Sarah Fathallah Hera Hussain Jessica Zéroual-Kara

Trauma-informed Research: A Panel Discussion

October 7, 2021