Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Noz Urbina
Rapid AI-powered UX (RAUX): A framework for empowering human designers
2025 • Rosenfeld Community
Jules Monza
Use These Words and Count These Things
2024 • DesignOps Summit 2024
Gold
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
Carol Scott
Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices
2025 • Rosenfeld Community
Sarit Geertjes
People, not Petri Dishes: Stories from a Research Recruiter
2019 • DesignOps Community
Shan Shen
Translating UX Terms into Business Contexts
2023 • Design in Product 2023
Gold
Megan Kierstead
You Are a Badass at UX: Overcoming Imposter Syndrome
2021 • Advancing Research 2021
Gold
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • DesignOps Summit 2022
Gold
Sarah Rink
Remote User Research: Dos and Don'ts from the Virtual Field
2020 • Advancing Research Community
Abby Covert
Panel: Collaboration Tools
2017 • DesignOps Summit 2017
Gold
Erin May
Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
2022 • Advancing Research 2022
Gold
Jen Crim
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold

More Videos

Jon White

"We end up with this junk drawer phenomenon with spaghetti-fication of different insights being passed around with no clarity."

Jon White Erin May

Unsticking Research for Better Information Flow

March 11, 2026

Luz Bratcher

"What if your value is measured by your being and not by your output?"

Luz Bratcher

This Is a Talk for Tired People

June 10, 2022

Ignacio Martinez

"Our evaluation tool is a Google Sheet so we can quickly make adjustments without being bogged down by unnecessary features."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Bria Alexander

"The pressure in design ops is often delivery-first mindset instead of quality and strategic impact - Dave Malu."

Bria Alexander Patrizia Bertini Peter Boersma Jon Fukuda Dave Malouf Theresa Slate Changying (Z) Zheng

Charting the future of DesignOps: A community workshop

April 18, 2024

Michael Weir

"The part of the brain we’re aware of is like the press release office; the real decisions happen behind closed doors."

Michael Weir

Mixed Methods and Behavioural Science

May 26, 2023

Sam Proulx

"If you build accessible shopping with these four keys, compliance with legal standards like WCAG will naturally fall into place."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Alla Weinberg

"Fear of losing your livelihood drives people to work longer hours and avoid asking for support."

Alla Weinberg

People Are Sick of Change: Psychological Safety is the Cure

July 20, 2023

Amy Paris

"Government forms need to represent identity and respect privacy so we can better serve all people."

Amy Paris Danielle Thierry

Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities

December 9, 2021

Francesca Barrientos, PhD

"We realized there was no way to make sense of the conglomeration of sticky notes."

Francesca Barrientos, PhD

You Need Your Own Definition of Design Maturity

June 8, 2022