Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 1 Panel
Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Day 1 Panel
Speakers: Cennydd Bowles , Dan Rosenberg and Lisa Welchman
Link:

Summary

In this panel discussion, Lisa Welchman, Kenneth Bowles, and Dan Rosenberg delved into the evolving role of designers in the age of AI, emphasizing ethical responsibility and the societal impact of design decisions. Kenneth Bowles highlighted the dual nature of responsibility in design—both backward-looking accountability and forward-looking duty—calling for designers to consider not just users but broader social and environmental stakeholders. Dan Rosenberg raised concerns about the ‘faith in the black box’ of AI and the upstream governance needed to prevent harm. The panelists debated the risk of AI commoditizing design roles and disintermediating human judgment. Lisa urged designers to assert agency, understand business deeply, and resist passivity, arguing for bolder engagement with tech’s ethical trajectories. They stressed that human judgment and empathy remain irreplaceable, especially in complex fields like healthcare. The importance of collaboration across silos and anticipatory design to manage AI’s unpredictable error states was also discussed. The panel concluded with encouragement to designers to deepen tech literacy, engage in ethical mitigation early, and shape AI’s future rather than passively accept it.

Key Insights

  • Design responsibility extends beyond users to society, environment, and the profession itself, demanding broader ethical consideration.

  • AI introduces a risk of commoditizing design work, particularly routine interface tasks that AI can automate within 12 to 36 months.

  • Human judgment remains critical and must not be ceded to AI, especially for discriminatory decisions and ethical complexities.

  • Understanding and linking design work to business strategy and value is essential for designers to maintain influence at the C-suite level.

  • Designers have significant agency but must proactively engage with AI technologies to shape their trajectory rather than resist passively.

  • Cross-disciplinary collaboration, especially between designers and data scientists, is necessary but challenged by entrenched organizational silos.

  • Designers should anticipate and design for AI error states, recognizing generative AI’s infinite unpredictability.

  • Techno-determinism is a pervasive risk; designers must challenge the inevitability mindset by actively influencing AI's ethical direction now.

  • Empathy and the embodied human experience are unique human factors that AI may fake but cannot replicate authentically.

  • Elevating UX roles upstream into product strategy and business leadership can help protect against devaluation due to AI automation.

Notable Quotes

"Designers have obligations not just to users but also to society and our own profession."

"We often point fingers at the person making the most money from the mess that designers put through the system."

"Faith in the black box makes me uneasy; as designers, we must care about what happens behind the scenes."

"I don’t think any designers today would hand over judgmental decisions fully to AI."

"If you don’t understand business, you don’t deserve a seat at the C-suite table."

"People remember how you made them feel, and that’s something AI can fake but not truly replicate."

"The risk is that AI will cut designers out of decision making because it’s perceived as cheaper or faster."

"Middle management often blocks collaboration despite desires from people underneath to work together."

"We need to design for the many error states generative AI can produce, however unpredictable."

"Technology does not have a mind of its own; people with power set its trajectory and we can influence that."

Ask the Rosenbot
Anna Avrekh
User Research, Design, and Product - A Love Story
2021 • Advancing Research 2021
Gold
Maria Skaaden
Continuous Design: One eye on the horizon and the other on the next wave
2018 • DesignOps Summit 2018
Gold
Shipra Kayan
Emerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow
2025 • Designing with AI 2025
Gold
Alëna Iouguina
Designing Systems at Scale
2018 • DesignOps Summit 2018
Gold
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
John Maeda
About Design Organizations
2019 • DesignOps Community
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Gretchen Anderson
Scaling the Human Center
2017 • Enterprise Experience 2017
Gold
Victor M. Gonzalez
Practicing Learners and Learning Practitioners
2021 • Advancing Research 2021
Gold
Lija Hogan
Three Years Out: Perspectives on the Near-Term Future of User Research
2024 • Advancing Research Community
Janaki Kumar
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Edgar Anzaldua Moreno
Using Research to Determine Unique Value Proposition
2021 • Advancing Research 2021
Gold

More Videos

Doug Powell

"There’s no faking it with this crowd."

Doug Powell

Closing Keynote: Design at Scale

November 8, 2018

Mila Kuznetsova

"A growth mindset in research means being ready to adapt protocols based on what actually works with participants."

Mila Kuznetsova Lucy Denton

How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices

March 9, 2022

Sarah Gallimore

"Evan actually spent less than 15 minutes on the essay, and instead of working on homework, he was writing a letter to his significant other back home in Detroit."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Lada Gorlenko

"You can’t really advocate for UX or move an organization forward without interacting with your team and business colleagues."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Alnie Figueroa

"Think of AI as an additional team member pushing your creative thinking and expanding your idea range."

Alnie Figueroa

The Future of Design Operations: Transforming Our Craft

September 10, 2025

Landon Barnes

"Statistical significance tells you if a change is likely not random, but it does not tell you if the change matters to your business."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Emily Eagle

"Every workaround is a mini story of somebody overcoming an obstacle."

Emily Eagle

Can't Rewind: Radio and Retail

June 3, 2019

Malini Rao

"There is no solid way to control the course of your re-platforming project; being flexible is essential."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Asia Hoe

"Assume positive intent, practice a service mindset, and curiosity over ego — remember we’re all in this together."

Asia Hoe

Partnering with Product: A Journey from Junior to Senior Design

November 29, 2023