Rosenverse
Augment the Human. Interrogate the System.

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • •

    Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • •

    Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • •

    Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • •

    The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • •

    Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • •

    Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • •

    Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • •

    Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • •

    Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • •

    Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
Cennydd Bowles
Exit Interview #2: Rediscovering the ethical heart of design
2025 • Rosenfeld Community
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Jennifer Strickland
Adopting a "Design By" Method
2021 • Civic Design 2021
Gold
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
Crystal Yan
Building a Customer-Centric Culture
2020 • Advancing Research 2020
Gold
Sheryl Cababa
Expanding your Design Lens with Systems Thinking
2023 • Advancing Research 2023
Gold
Kate Towsey
Ask Me Anything (AMA) with Kate Towsey
2025 • Rosenfeld Community
Rachael Dietkus, LCSW
AI: Passionate defenses and reasoned critique [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Eduardo Ortiz
Theme 3 Intro
2025 • Advancing Research 2025
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young
2019 • Advancing Research Community
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Maria Giudice
Remaking the Making Company: Moving from Product to Experience
2016 • Enterprise UX 2016
Gold
Theresa Marwah
How Atlassian is Operationalizing Respect in Research
2020 • Advancing Research Community
Carol Smith
Operationalizing Responsible, Human-Centered AI
2023 • Enterprise UX 2023
Gold

More Videos

Dr. Karl Jeffries

"If you value innovation and design, then you're investing in creativity."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"Investment is attention: If the business funds you, it means they believe in what you do."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Building an internal research practice is critical for long-term value and integration of insights."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"Agency style staffing allows designers to bring learnings across multiple projects and grow through new challenges."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"Puppetry lets you communicate like, I don’t like what you said, how come you said that to me."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"Field usability testing showed stakeholders immediately how much value UX can add by catching issues before deployment."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"Our principle is that whatever we build must help researchers avoid becoming a silo."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"Nobody loves it when someone from another department shows up to tell people how to do their jobs better."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"Combining the what we see in data with the why we get from user research is where true insights live."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books