Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Panel

Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
Day 2 Panel
Speakers: Sheryl Cababa , Ethan Marcotte and Milena Pribic
Link:

Summary

In this panel discussion, Cheryl Kaba, Ethan Marotz, and Meena Previ reflect on the challenges and opportunities of designing with AI. Cheryl highlights the need to think beyond narrow AI use cases, stressing long-term impacts and ethical considerations, especially in education where AI might replace teachers. Ethan points to AI shifting design roles to supervisory or editorial, raising concerns about de-skilling and labor protections, drawing parallels to recent labor strikes in creative industries. Meena emphasizes ethical AI practices, co-creation with stakeholders, and transparency, cautioning against blind acceptance of AI outputs. Together, they explore the importance of intentionality, participatory design, and power dynamics in AI systems, noting capitalism’s role in shaping AI's adoption and urging designers to critically engage in shaping AI’s future. The panel also discusses transparency in AI confidence, ethical frameworks beyond compliance, and the lifecycle of AI hype. They close with calls for conversations among coworkers about AI’s role, and critical questioning of who designs AI and for whom, advocating sustained reflection on AI's social and labor impacts.

Key Insights

  • AI design is currently in an experimental stage, often focused on narrow use cases rather than broad impacts.

  • The shift to AI often changes designers' roles from creators to supervisors, potentially leading to workforce de-skilling.

  • Ethical AI practices require active inclusion of marginalized groups in the design and feedback processes.

  • Transparency about AI confidence levels has decreased in modern chatbots, complicating trust and interpretation.

  • Designers must balance augmentation and automation carefully to avoid disempowerment and job losses.

  • Power dynamics are central to AI system design; systems should promote empowerment rather than control.

  • Sustainability and AI's environmental impact are often overlooked in technology discussions.

  • Ethical frameworks vary and should be adapted to specific communities and organizational goals rather than treated as universally equal.

  • Labor movements and unionization are relevant lenses to consider protections against AI-driven labor changes.

  • Effective AI integration requires intentional conversations and collective reflection among workplace stakeholders.

Notable Quotes

"We’re in this initial stage of tinkering, just trying to make the tech behave the way we expect it to."

"AI moves the practitioner into an editorial or supervisory role, which often signals de-skilling."

"We want AI to augment human skills like an electric bike, not replace them like a robotic vacuum cleaner."

"Who is designing these AI systems, why, and for whom? Are those most impacted even involved?"

"Designers need to have critical conversations with stakeholders about the direction and impacts of AI."

"Ethics is not just about compliance; it’s about doing the right thing holistically."

"Most people’s fears about AI are actually fears about capitalism."

"Transparency of AI’s confidence has mostly disappeared because generative AI is inherently confident by design."

"AI tools today are sandwiches in search of picnics—useful, but lacking killer applications yet."

"We need to redesign capitalism, but right now we don’t have time for that."

Ask the Rosenbot
Nick Lewis
Designing and building low-carbon websites independently
2025 • Climate UX Interest Group
Sean Fitzell
Craft of User Research: Building Out Jobs to be Done Maps
2021 • Advancing Research 2021
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Paul Ford
New work, new words: A glossary for AI
2026 • Designing with AI 2026
Conference
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold
Bethany Brown
Rewiring operations with service design and AI
2025 • Advancing Service Design 2025
Gold
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Dr. Nikki Smith
Research Strategy: Connecting Insights to Outcomes
2025 • Advancing Research 2025
Gold
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
Rachael Dietkus, LCSW
Leading through the long tail of trauma
2022 • Advancing Research Community
Rachael Dietkus, LCSW
The power to heal and harm
2025 • Advancing Research 2025
Gold
Shelby Switzer
Making Space for Community Knowledge-sharing in a Distributed World
2021 • Civic Design 2021
Gold
Erin Hauber
Design is Not the Frosting on the Scaled Agile Layer Cake
2019 • DesignOps Summit 2019
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold

More Videos

Bria Alexander

"Every talk you hear today couldn’t get more personal to our community."

Bria Alexander

Theme Two Intro

October 3, 2023

Ariba Jahan

"People were taking vacation days just to homeschool or take care of a loved one."

Ariba Jahan

Team Resiliency Through a Pandemic

January 8, 2024

Cornelius Rachieru

"Design projects in product design are led by designers, but in service design they are facilitated or co-facilitated by designers among many perspectives."

Cornelius Rachieru

Handling Complexity: Framing a Scale of Design

June 9, 2021

Megan Clegg

"Automated tests only get you so far; manual QA by people aware of accessibility needs is essential."

Megan Clegg Michael Haggerty-Villa Alexis Morin

Space for Everyone: Reframing Accessibility Through a Wider Lens

June 10, 2021

Saara Kamppari-Miller

"Crowdsourcing the map meant anyone in our community practice could edit, and it worked beautifully."

Saara Kamppari-Miller

Cartography for Design Communities

September 10, 2025

Kara Kane

"Civic design and government design practice have reached many milestones in the past 10 years."

Kara Kane

Theme One Intro

November 16, 2022

Natalia Radywyl

"Design for the government was something you do to outsource web development, not for serious problems."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Nancy Douyon

"Tay became a racist, sexist monster in less than eight hours because it learned from toxic internet data."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Peter Van Dijck

"Without proper evaluation, you’re just building a demo – demos are easy, quality production is hard."

Peter Van Dijck

Building the Rosenbot

June 4, 2024