Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Panel
Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
Day 2 Panel
Speakers: Sheryl Cababa , Ethan Marcotte and Milena Pribic
Link:

Summary

In this panel discussion, Cheryl Kaba, Ethan Marotz, and Meena Previ reflect on the challenges and opportunities of designing with AI. Cheryl highlights the need to think beyond narrow AI use cases, stressing long-term impacts and ethical considerations, especially in education where AI might replace teachers. Ethan points to AI shifting design roles to supervisory or editorial, raising concerns about de-skilling and labor protections, drawing parallels to recent labor strikes in creative industries. Meena emphasizes ethical AI practices, co-creation with stakeholders, and transparency, cautioning against blind acceptance of AI outputs. Together, they explore the importance of intentionality, participatory design, and power dynamics in AI systems, noting capitalism’s role in shaping AI's adoption and urging designers to critically engage in shaping AI’s future. The panel also discusses transparency in AI confidence, ethical frameworks beyond compliance, and the lifecycle of AI hype. They close with calls for conversations among coworkers about AI’s role, and critical questioning of who designs AI and for whom, advocating sustained reflection on AI's social and labor impacts.

Key Insights

  • AI design is currently in an experimental stage, often focused on narrow use cases rather than broad impacts.

  • The shift to AI often changes designers' roles from creators to supervisors, potentially leading to workforce de-skilling.

  • Ethical AI practices require active inclusion of marginalized groups in the design and feedback processes.

  • Transparency about AI confidence levels has decreased in modern chatbots, complicating trust and interpretation.

  • Designers must balance augmentation and automation carefully to avoid disempowerment and job losses.

  • Power dynamics are central to AI system design; systems should promote empowerment rather than control.

  • Sustainability and AI's environmental impact are often overlooked in technology discussions.

  • Ethical frameworks vary and should be adapted to specific communities and organizational goals rather than treated as universally equal.

  • Labor movements and unionization are relevant lenses to consider protections against AI-driven labor changes.

  • Effective AI integration requires intentional conversations and collective reflection among workplace stakeholders.

Notable Quotes

"We’re in this initial stage of tinkering, just trying to make the tech behave the way we expect it to."

"AI moves the practitioner into an editorial or supervisory role, which often signals de-skilling."

"We want AI to augment human skills like an electric bike, not replace them like a robotic vacuum cleaner."

"Who is designing these AI systems, why, and for whom? Are those most impacted even involved?"

"Designers need to have critical conversations with stakeholders about the direction and impacts of AI."

"Ethics is not just about compliance; it’s about doing the right thing holistically."

"Most people’s fears about AI are actually fears about capitalism."

"Transparency of AI’s confidence has mostly disappeared because generative AI is inherently confident by design."

"AI tools today are sandwiches in search of picnics—useful, but lacking killer applications yet."

"We need to redesign capitalism, but right now we don’t have time for that."

Ask the Rosenbot
Jay Bustamante
Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
2023 • DesignOps Summit 2023
Gold
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Steve Portigal
War Stories LIVE! Q&A-Discussion
2020 • Advancing Research 2020
Gold
Verónica Urzúa
The B-side of the Research Impact
2021 • Advancing Research 2021
Gold
Darian Davis
Lessons from a Toxic Work Relationship
2024 • Enterprise Experience 2020
Gold
Crystal Yan
Building a Customer-Centric Culture
2020 • Advancing Research 2020
Gold
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Ron Bronson
Design, Consequences & Everyday Life
2022 • Civic Design 2022
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Rebecca Buck
Mission: Keep Talent in Research Roles!
2021 • Advancing Research 2021
Gold
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold
PJ Buddhari
Meet Spectrum, Adobe’s Design System
2021 • Design at Scale 2021
Gold
George Hinchliffe
Delivering Amazing Experiences
2021 • Design at Scale 2021
Gold

More Videos

Kurt McCulloch

"When you boil down all the research into actions someone might take, the thing that made our research valuable in the first place, understanding context, was all gone."

Kurt McCulloch

Faster alone, further together: Rebuilding collaboration in the age of AI research

March 10, 2026

Dan Willis

"It's okay. I just wish it were a little bit jazzier and sexier."

Dan Willis

Enterprise Storytelling Sessions

May 13, 2015

Lavrans Løvlie

"The new chapter in the second edition looks at service design as a change methodology for organizations, recognizing how ambitious it can be."

Lavrans Løvlie Ben Reason

Ask me anything – Authors of Service Design: From Insight to Implementation

November 19, 2025

Jon White

"What good are the insights if we can’t get them where they need to go, when they need to go there, and make sure they get used?"

Jon White Erin May

Unsticking Research for Better Information Flow

March 11, 2026

Liwei Dai

"After more than 10 years of doing UX research, I was still only working above the iceberg, focusing on the usability and feature level."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Smitha Papolu

"When I was at IBM, embedded designers were expected to fit in seamlessly, which was an honor."

Smitha Papolu Nova Wehman-Brown Melissa Schmidt Adam Menter

Theme 3 Discussion

January 8, 2024

Sheryl Cababa

"If you’re working at scale, many problems that seem like 'clock' problems actually have 'cloud' elements."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023

Mansi Gupta

"How can we not forget about women?"

Mansi Gupta

Women-Centric Research: What, Why, How

March 29, 2023

Francesca Barrientos, PhD

"We had to push back on the idea that we could just use existing models without understanding our team’s needs."

Francesca Barrientos, PhD

You Need Your Own Definition of Design Maturity

June 8, 2022