Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 1 Panel
Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Day 1 Panel
Speakers: Cennydd Bowles , Dan Rosenberg and Lisa Welchman
Link:

Summary

In this panel discussion, Lisa Welchman, Kenneth Bowles, and Dan Rosenberg delved into the evolving role of designers in the age of AI, emphasizing ethical responsibility and the societal impact of design decisions. Kenneth Bowles highlighted the dual nature of responsibility in design—both backward-looking accountability and forward-looking duty—calling for designers to consider not just users but broader social and environmental stakeholders. Dan Rosenberg raised concerns about the ‘faith in the black box’ of AI and the upstream governance needed to prevent harm. The panelists debated the risk of AI commoditizing design roles and disintermediating human judgment. Lisa urged designers to assert agency, understand business deeply, and resist passivity, arguing for bolder engagement with tech’s ethical trajectories. They stressed that human judgment and empathy remain irreplaceable, especially in complex fields like healthcare. The importance of collaboration across silos and anticipatory design to manage AI’s unpredictable error states was also discussed. The panel concluded with encouragement to designers to deepen tech literacy, engage in ethical mitigation early, and shape AI’s future rather than passively accept it.

Key Insights

  • Design responsibility extends beyond users to society, environment, and the profession itself, demanding broader ethical consideration.

  • AI introduces a risk of commoditizing design work, particularly routine interface tasks that AI can automate within 12 to 36 months.

  • Human judgment remains critical and must not be ceded to AI, especially for discriminatory decisions and ethical complexities.

  • Understanding and linking design work to business strategy and value is essential for designers to maintain influence at the C-suite level.

  • Designers have significant agency but must proactively engage with AI technologies to shape their trajectory rather than resist passively.

  • Cross-disciplinary collaboration, especially between designers and data scientists, is necessary but challenged by entrenched organizational silos.

  • Designers should anticipate and design for AI error states, recognizing generative AI’s infinite unpredictability.

  • Techno-determinism is a pervasive risk; designers must challenge the inevitability mindset by actively influencing AI's ethical direction now.

  • Empathy and the embodied human experience are unique human factors that AI may fake but cannot replicate authentically.

  • Elevating UX roles upstream into product strategy and business leadership can help protect against devaluation due to AI automation.

Notable Quotes

"Designers have obligations not just to users but also to society and our own profession."

"We often point fingers at the person making the most money from the mess that designers put through the system."

"Faith in the black box makes me uneasy; as designers, we must care about what happens behind the scenes."

"I don’t think any designers today would hand over judgmental decisions fully to AI."

"If you don’t understand business, you don’t deserve a seat at the C-suite table."

"People remember how you made them feel, and that’s something AI can fake but not truly replicate."

"The risk is that AI will cut designers out of decision making because it’s perceived as cheaper or faster."

"Middle management often blocks collaboration despite desires from people underneath to work together."

"We need to design for the many error states generative AI can produce, however unpredictable."

"Technology does not have a mind of its own; people with power set its trajectory and we can influence that."

Ask the Rosenbot
Corey Nelson
Layoffs
2022 • Advancing Research Community
Alicia Mooty
Design Staffing Models
2021 • DesignOps Summit 2021
Gold
Marc Majers
Interrupted UX - Add A Dose of Reality To Usability Testing
2022 • Advancing Research 2022
Gold
Lisa Welchman
Cleaning Up Our Mess: Digital Governance for Designers
2018 • Enterprise Experience 2018
Gold
Asia Hoe
Partnering with Product: A Journey from Junior to Senior Design
2023 • Design in Product 2023
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold
Courtney Kaplan
Taking it to the next level: Career paths in DesignOps
2018 • DesignOps Summit 2018
Gold
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Saara Kamppari-Miller
Theme Three Intro
2023 • DesignOps Summit 2023
Gold
Bria Alexander
Day 2 Welcome
2024 • DesignOps Summit 2024
Gold
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Lena Shenkarenko
Collaborative Wireframing for Creating Team Alignment and Shipping Better Products
2020 • DesignOps Summit 2020
Gold
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group
Tricia Wang
SCALE: Discussion
2018 • Enterprise Experience 2018
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Kathleen Asjes
Research Democratization: the Good, the Bad and the Ugly
2022 • Advancing Research 2022
Gold

More Videos

Sam Proulx

"Accessibility isn’t a checkbox you run automated tests for; you must involve people with disabilities to benchmark success."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Ignacio Martinez

"We want to build consultants who can solve problems across a variety of projects and clients."

Ignacio Martinez

Fair and Effective Designer Evaluation

September 25, 2024

Sarah Kinkade

"Using program dollars to hire freelancers helped me avoid difficult conversations with HR and finance early on."

Sarah Kinkade Mariana Ortiz-Reyes

Design Management Models in the Face of Transformation

June 8, 2022

Daniel Gloyd

"We as humans value warmth information in others more than competence information."

Daniel Gloyd

Warming the User Experience: Lessons from America's first and most radical human-centered designers

May 9, 2024

Patrick Boehler

"We spend millions on content that nobody wanted and that didn’t actually help people navigate their lives."

Patrick Boehler

Fishing for Real Needs: Reimagining Journalism Needs with AI

June 10, 2025

Andy Barraclough

"Our AI tools help with speed and efficiency, and also help save money by reducing redundant research."

Andy Barraclough Betsy Nelson

From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme

September 23, 2024

Alexandra Schmidt

"I’m totally freaked out by facial recognition and wonder why we don’t get together as consumers to push back on bad designs."

Alexandra Schmidt

Why Ethics Can't Save Tech

November 18, 2022

Louis Rosenfeld

"In government, the motivation is reduction of misery: why are we up at 3 AM fixing something avoidable?"

Louis Rosenfeld

Discussion: What Operations can teach DesignOps

November 6, 2017

Mitchell Bernstein

"Discomfort and growth cannot coexist. You have to embrace discomfort to push innovation forward."

Mitchell Bernstein

Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape

September 29, 2021