Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Panel
Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
Day 2 Panel
Speakers: Sheryl Cababa , Ethan Marcotte and Milena Pribic
Link:

Summary

In this panel discussion, Cheryl Kaba, Ethan Marotz, and Meena Previ reflect on the challenges and opportunities of designing with AI. Cheryl highlights the need to think beyond narrow AI use cases, stressing long-term impacts and ethical considerations, especially in education where AI might replace teachers. Ethan points to AI shifting design roles to supervisory or editorial, raising concerns about de-skilling and labor protections, drawing parallels to recent labor strikes in creative industries. Meena emphasizes ethical AI practices, co-creation with stakeholders, and transparency, cautioning against blind acceptance of AI outputs. Together, they explore the importance of intentionality, participatory design, and power dynamics in AI systems, noting capitalism’s role in shaping AI's adoption and urging designers to critically engage in shaping AI’s future. The panel also discusses transparency in AI confidence, ethical frameworks beyond compliance, and the lifecycle of AI hype. They close with calls for conversations among coworkers about AI’s role, and critical questioning of who designs AI and for whom, advocating sustained reflection on AI's social and labor impacts.

Key Insights

  • AI design is currently in an experimental stage, often focused on narrow use cases rather than broad impacts.

  • The shift to AI often changes designers' roles from creators to supervisors, potentially leading to workforce de-skilling.

  • Ethical AI practices require active inclusion of marginalized groups in the design and feedback processes.

  • Transparency about AI confidence levels has decreased in modern chatbots, complicating trust and interpretation.

  • Designers must balance augmentation and automation carefully to avoid disempowerment and job losses.

  • Power dynamics are central to AI system design; systems should promote empowerment rather than control.

  • Sustainability and AI's environmental impact are often overlooked in technology discussions.

  • Ethical frameworks vary and should be adapted to specific communities and organizational goals rather than treated as universally equal.

  • Labor movements and unionization are relevant lenses to consider protections against AI-driven labor changes.

  • Effective AI integration requires intentional conversations and collective reflection among workplace stakeholders.

Notable Quotes

"We’re in this initial stage of tinkering, just trying to make the tech behave the way we expect it to."

"AI moves the practitioner into an editorial or supervisory role, which often signals de-skilling."

"We want AI to augment human skills like an electric bike, not replace them like a robotic vacuum cleaner."

"Who is designing these AI systems, why, and for whom? Are those most impacted even involved?"

"Designers need to have critical conversations with stakeholders about the direction and impacts of AI."

"Ethics is not just about compliance; it’s about doing the right thing holistically."

"Most people’s fears about AI are actually fears about capitalism."

"Transparency of AI’s confidence has mostly disappeared because generative AI is inherently confident by design."

"AI tools today are sandwiches in search of picnics—useful, but lacking killer applications yet."

"We need to redesign capitalism, but right now we don’t have time for that."

Ask the Rosenbot
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Megan Campos
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
2021 • Advancing Research 2021
Gold
Daniela Magaña Flores
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
2022 • Advancing Research 2022
Gold
Jeff Ephraim Bander
Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research
2022 • Advancing Research 2022
Gold
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Sarah Rink
Remote User Research: Dos and Don'ts from the Virtual Field
2020 • Advancing Research Community
Jamika Burge
Embracing change: Navigating shifting landscapes with compassion and agency
2025 • Advancing Research 2025
Gold
Tim Frick
The journey of building a sustainable design practice
2025 • Climate UX Interest Group
Uday Gajendar
Theme 1: Introduction
2021 • Design at Scale 2021
Gold
Tristin Oldani
Turning awareness into action with Climate UX
2025 • Climate UX Interest Group
Victor Udoewa
Research in the Pluriverse
2023 • Advancing Research 2023
Gold
Dave Malouf
The Past, Present, and Future of DesignOps: a 2-part DesignOps Community Call (Part 2)
2022 • DesignOps Community
Dave Hoffer
UX Job Search AMA #3 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold
Alexandra Schmidt
Why Ethics Can't Save Tech
2022 • Civic Design 2022
Gold

More Videos

Scott Plewes

"Math models don’t just provide numerical precision, they can be inspirational for thinking about UX spread."

Scott Plewes

Why Isn't Your UX Approach Going Viral?: A Mathematical Model

March 28, 2023

Alison Rand

"There’s no other theory of change I’ve seen more true in large organizations than requiring dual-level support."

Alison Rand Sarah Brooks

Scaling Impact with Service Design

March 25, 2021

Rachael Dietkus, LCSW

"Minimizing harm protects institutions, not people."

Rachael Dietkus, LCSW

The power to heal and harm

March 13, 2025

Sheryl Cababa

"Involving stakeholders with lived experience empowers design and enriches domain knowledge."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023

Renee Bouwens

"Being nimble means sometimes you have to throw out academic rigor and just do what’s practical at the moment."

Renee Bouwens

Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products

December 15, 2023

JP Allen

"Sometimes we had to add bus lines simply because some tools couldn’t fit into the existing grid."

JP Allen Holly Holden

Navigating the UX Tools Landscape

October 1, 2021

Bria Alexander

"You don’t want to miss out on the sponsor sessions — they’re free and high quality, not sales pitches."

Bria Alexander

Opening Remarks

November 18, 2022

Llewyn Paine

"Processing limits and licensing terms currently restrict how much video and audio these AI tools can handle."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Ricardo Martins

"Customers can answer what the researcher wants to hear in surveys, making attitude only 28% predictive of real behavior."

Ricardo Martins

Unlocking the power of advanced quantitative methods

March 12, 2025