Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 1 Panel

Gold
Tuesday, June 4, 2024 • Designing with AI 2024
Share the love for this talk
Day 1 Panel
Speakers: Cennydd Bowles , Dan Rosenberg and Lisa Welchman
Link:

Summary

In this panel discussion, Lisa Welchman, Kenneth Bowles, and Dan Rosenberg delved into the evolving role of designers in the age of AI, emphasizing ethical responsibility and the societal impact of design decisions. Kenneth Bowles highlighted the dual nature of responsibility in design—both backward-looking accountability and forward-looking duty—calling for designers to consider not just users but broader social and environmental stakeholders. Dan Rosenberg raised concerns about the ‘faith in the black box’ of AI and the upstream governance needed to prevent harm. The panelists debated the risk of AI commoditizing design roles and disintermediating human judgment. Lisa urged designers to assert agency, understand business deeply, and resist passivity, arguing for bolder engagement with tech’s ethical trajectories. They stressed that human judgment and empathy remain irreplaceable, especially in complex fields like healthcare. The importance of collaboration across silos and anticipatory design to manage AI’s unpredictable error states was also discussed. The panel concluded with encouragement to designers to deepen tech literacy, engage in ethical mitigation early, and shape AI’s future rather than passively accept it.

Key Insights

  • Design responsibility extends beyond users to society, environment, and the profession itself, demanding broader ethical consideration.

  • AI introduces a risk of commoditizing design work, particularly routine interface tasks that AI can automate within 12 to 36 months.

  • Human judgment remains critical and must not be ceded to AI, especially for discriminatory decisions and ethical complexities.

  • Understanding and linking design work to business strategy and value is essential for designers to maintain influence at the C-suite level.

  • Designers have significant agency but must proactively engage with AI technologies to shape their trajectory rather than resist passively.

  • Cross-disciplinary collaboration, especially between designers and data scientists, is necessary but challenged by entrenched organizational silos.

  • Designers should anticipate and design for AI error states, recognizing generative AI’s infinite unpredictability.

  • Techno-determinism is a pervasive risk; designers must challenge the inevitability mindset by actively influencing AI's ethical direction now.

  • Empathy and the embodied human experience are unique human factors that AI may fake but cannot replicate authentically.

  • Elevating UX roles upstream into product strategy and business leadership can help protect against devaluation due to AI automation.

Notable Quotes

"Designers have obligations not just to users but also to society and our own profession."

"We often point fingers at the person making the most money from the mess that designers put through the system."

"Faith in the black box makes me uneasy; as designers, we must care about what happens behind the scenes."

"I don’t think any designers today would hand over judgmental decisions fully to AI."

"If you don’t understand business, you don’t deserve a seat at the C-suite table."

"People remember how you made them feel, and that’s something AI can fake but not truly replicate."

"The risk is that AI will cut designers out of decision making because it’s perceived as cheaper or faster."

"Middle management often blocks collaboration despite desires from people underneath to work together."

"We need to design for the many error states generative AI can produce, however unpredictable."

"Technology does not have a mind of its own; people with power set its trajectory and we can influence that."

Ask the Rosenbot
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Toby Haug
Discussion
2017 • Enterprise Experience 2017
Gold
Amy Paris
Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities
2021 • Civic Design 2021
Gold
Jon Fukuda
Theme One Intro
2022 • DesignOps Summit 2022
Gold
Erika Flowers
AI-Readiness: Preparing NASA for a Data-Driven, Agile Future
2025 • Designing with AI 2025
Gold
Shreya Dhawan
Making service tangible: the fastest path to higher performance
2025 • Advancing Service Design 2025
Gold
Leah Buley
Closing Plenary: The Crisis of Digital
2020 • Advancing Research 2020
Gold
Trisha Causley
[Demo] Complexity in disguise: Crafting experiences for generative AI features
2024 • Designing with AI 2024
Gold
Kara Kane
Communities of Practice for Civic Design
2022 • Civic Design Community
Michael Weir
Mixed Methods and Behavioural Science
2023 • Rosenfeld Community
Dr. Jamika D. Burge
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Jake Burghardt
Stop wasting research: Create new value with insight summaries
2025 • Rosenfeld Community
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Megan Clegg
Space for Everyone: Reframing Accessibility Through a Wider Lens
2021 • Design at Scale 2021
Gold
Nidhi Singh Rathore
Embracing participation to unlock deeper truths in commercial research
2025 • Advancing Research 2025
Gold

More Videos

Eduardo Ortiz

"We have to give ourselves space to tell impact stories that aren’t quantified; numbers don’t always capture the full picture of success."

Eduardo Ortiz Robin Beers Rachael Dietkus, LCSW Bruce Gillespie Jess Greco Marieke McCloskey Renee Reid

Day 3 Theme Panel

March 13, 2025

Richard Buchanan

"Principles give unity and organization to a product, system, or human experience, not just guidelines or rules of thumb."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Jorge Arango

"People who took notes by hand tend to have better recall than those typing notes because they process information differently."

Jorge Arango

The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars)

April 5, 2024

Cheryl Platz

"Mastery is a core human motivator; people want to understand and feel competent in what they do."

Cheryl Platz

Embrace Your Fun Factor: Game Development Best Practices for Product Design

January 9, 2026

Ash Brown

"Education is the foundation upon which we build a more sustainable future."

Ash Brown

Silver Linings: What DesignOps Learned in the Shift to WFH

October 23, 2020

Angelos Arnis

"Design is navigating through unprecedented times."

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

Jeff Gothelf

"Key results must be measures of human behavior and outcomes, not output metrics like 'launch this service'."

Jeff Gothelf

Who does what by how much?

November 20, 2025

Sam Proulx

"Accessibility is no longer an unusual hack; it is the responsibility of all of us to create accessible products."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

September 9, 2022

Brendan Jarvis

"Fear is in the air as AI seems to be coming for our jobs, but fear doesn’t suit us—we are too optimistic, too creative, and too valuable."

Brendan Jarvis

It was the Best of Times. It was the Worst of Times.

September 25, 2024