Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Panel
Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
Day 2 Panel
Speakers: Sheryl Cababa , Ethan Marcotte and Milena Pribic
Link:

Summary

In this panel discussion, Cheryl Kaba, Ethan Marotz, and Meena Previ reflect on the challenges and opportunities of designing with AI. Cheryl highlights the need to think beyond narrow AI use cases, stressing long-term impacts and ethical considerations, especially in education where AI might replace teachers. Ethan points to AI shifting design roles to supervisory or editorial, raising concerns about de-skilling and labor protections, drawing parallels to recent labor strikes in creative industries. Meena emphasizes ethical AI practices, co-creation with stakeholders, and transparency, cautioning against blind acceptance of AI outputs. Together, they explore the importance of intentionality, participatory design, and power dynamics in AI systems, noting capitalism’s role in shaping AI's adoption and urging designers to critically engage in shaping AI’s future. The panel also discusses transparency in AI confidence, ethical frameworks beyond compliance, and the lifecycle of AI hype. They close with calls for conversations among coworkers about AI’s role, and critical questioning of who designs AI and for whom, advocating sustained reflection on AI's social and labor impacts.

Key Insights

  • AI design is currently in an experimental stage, often focused on narrow use cases rather than broad impacts.

  • The shift to AI often changes designers' roles from creators to supervisors, potentially leading to workforce de-skilling.

  • Ethical AI practices require active inclusion of marginalized groups in the design and feedback processes.

  • Transparency about AI confidence levels has decreased in modern chatbots, complicating trust and interpretation.

  • Designers must balance augmentation and automation carefully to avoid disempowerment and job losses.

  • Power dynamics are central to AI system design; systems should promote empowerment rather than control.

  • Sustainability and AI's environmental impact are often overlooked in technology discussions.

  • Ethical frameworks vary and should be adapted to specific communities and organizational goals rather than treated as universally equal.

  • Labor movements and unionization are relevant lenses to consider protections against AI-driven labor changes.

  • Effective AI integration requires intentional conversations and collective reflection among workplace stakeholders.

Notable Quotes

"We’re in this initial stage of tinkering, just trying to make the tech behave the way we expect it to."

"AI moves the practitioner into an editorial or supervisory role, which often signals de-skilling."

"We want AI to augment human skills like an electric bike, not replace them like a robotic vacuum cleaner."

"Who is designing these AI systems, why, and for whom? Are those most impacted even involved?"

"Designers need to have critical conversations with stakeholders about the direction and impacts of AI."

"Ethics is not just about compliance; it’s about doing the right thing holistically."

"Most people’s fears about AI are actually fears about capitalism."

"Transparency of AI’s confidence has mostly disappeared because generative AI is inherently confident by design."

"AI tools today are sandwiches in search of picnics—useful, but lacking killer applications yet."

"We need to redesign capitalism, but right now we don’t have time for that."

Ask the Rosenbot
Courtney Maya George
Scale Your Organization and Grow Your Designers
2022 • DesignOps Summit 2022
Gold
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Janaki Kumar
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Failure Friday #4: Invisible Work: How I Stalled My Career by Not Showing My Work
2025 • Rosenfeld Community
Lada Gorlenko
Theme 3: Introduction
2021 • Design at Scale 2021
Gold
Ashley Cortez
Shifting Toward Community-Led Innovation in Local Government
2021 • Civic Design 2021
Gold
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group
Melissa Eggleston
Practical People Skills for Building Trust on Teams and with Partners
2021 • Civic Design 2021
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Theresa Neil
Designing for Wellness: Specializing in Healthcare
2024 • Rosenfeld Community
Nathan Curtis
Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough?
2019 • DesignOps Community
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Jemma Ahmed
Research at an inflection point: Adapting to a new era of collaboration, equity, and innovation
2025 • Advancing Research 2025
Gold
Steve Sanderson
Discussion
2015 • Enterprise UX 2015
Gold

More Videos

Darian Davis

"A common toxic behavior is glory seeking, like presenting work as your own when it was a team effort."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Aaron Stienstra

"The equity executive order calls for a whole-of-government transformation—think about the scale of that."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021

Kavana Ramesh

"Think of assistive technology in three categories: screen readers, screen magnification, and alternative navigation."

Kavana Ramesh

Meaningful inclusion: Practicing accessibility research with confidence

September 24, 2024

Helen Armstrong

"The relationship between designers and data scientists can actually be pretty magical."

Helen Armstrong

Augment the Human. Interrogate the System.

June 7, 2023

Scott Plewes

"A model is a simplified representation of a system, whether in math or UX."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023

Christian Bason

"Governments pretending to be rational is a flawed assumption; we must incorporate emotion and bodily experience in policymaking."

Christian Bason

Expand—Rethinking Design for Public Challenges

September 14, 2022

Peter Van Dijck

"Context design and context engineering mean figuring out and building what needs to go into that text file sent to the model."

Peter Van Dijck

Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!

July 30, 2025

Soma Ghosh

"Everything is designed, much of it poorly, so it’s incumbent on us to redesign capitalism and systems more inclusively."

Soma Ghosh Savina Hawkins Dave Hoffer Rob Thomas Victor Udoewa

What emerging methods are advancing UX research [Advancing Research Community Workshop Series]

September 28, 2023

Steve Portigal

"Someone who thinks a study will run perfectly every time probably isn’t very experienced or realistic."

Steve Portigal Susan Simon-Daniels Tamara Hale Randolph Duke II

War Stories LIVE! Q&A-Discussion

March 30, 2020