Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation

Thursday, December 11, 2025 • DesignOps Community
Share the love for this talk
Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
Speakers: Patrizia Bertini
Link:

Summary

Are you building or using AI in your products? Do you have customers in the EU, or plan to? If so, the EU AI Act isn’t just another piece of legislation. It’s a blueprint for the future of digital product design, a signal of where responsible, human-centered technology is headed. As the world’s first comprehensive AI law, the Act sets new expectations for trust, transparency, and accountability. And it doesn’t matter whether your team is in San Francisco, Singapore, or Sydney: if you build or use AI, this shift affects you. Let’s stop treating AI like a race, and start seeing it as a design challenge: how to build products that people trust, adopt, and keep using. From chatbots to recommendation engines, every AI-powered experience will soon need to meet standards for safety, explainability, and fairness. But this isn’t only about compliance. It’s about turning responsibility into a competitive edge, building systems that last, and products that lead. In this session, we’ll unpack what the EU AI Act means for design, product, and operations leaders, in plain language, no legal jargon required. You’ll walk away understanding: - How AI systems are classified and why “high risk” might apply to your product even if you’re not in the EU - Why transparency, documentation, and human oversight are becoming core design principles - How acting early can strengthen user trust, reduce risk, and set your team apart - How design and product roles are evolving and why that shift is an opportunity, not a threat This isn’t about avoiding fines. It’s about leading with integrity, designing technology people believe in, and using regulation as a launchpad for innovation. Whether you’re a designer, product manager, or operations leader, this session will help you understand what’s changing, take action now, and turn the EU AI Act into your next innovation catalyst.

Key Insights

  • The EU AI Act introduces penalties up to 35 million euros or 7% of global turnover for non-compliance, affecting any company serving European customers.

  • AI is agency with impact, not just a tool; it can make decisions dramatically affecting human lives.

  • Transparency and accountability are core to the AI Act, requiring detailed documentation and auditable logs of all AI decisions, preserved for up to 10 years.

  • High-risk AI systems, such as those used in healthcare or hiring, require bias testing, human oversight, and clear escalation paths.

  • Many current AI systems cannot be retrofitted to comply, making early compliance and documentation essential.

  • Chatbots are generally low or limited risk but become high risk if their decisions significantly impact humans, such as insurance claims denial.

  • Synthetic content generated or altered by AI must be persistently labeled as such to maintain transparency for users and auditors.

  • Human oversight must prevail in AI interactions; humans retain accountability and must be able to override AI decisions.

  • Designers need to create flows that embed human control, transparency, and accountability, moving beyond traditional user flows to 'agent flows' managing AI interactions.

  • Organizations should map their AI systems, classify risk levels, assign responsibility, and prioritize compliance as part of their product strategies.

Notable Quotes

"The AI Act can spark better innovation with AI rather than constraining it."

"Speed is not everything we need velocity—speed plus direction is key."

"AI is not a tool. AI has agency. AI makes decisions that impact people's lives."

"Machines cannot be accountable; responsibility is always human."

"If you are building or deploying AI that impacts people, you need to document everything."

"Transparency requires all decisions to be clear and understandable to non-technical users."

"Humans need to override and dominate AI because machines have no context or experience."

"Most AI systems today cannot be retrofitted easily to comply with regulation."

"Everything touched by AI becomes synthetic and needs persistent labeling."

"Real innovation is not being first; it's about doing it right and sustainably."

Ask the Rosenbot
Jessamyn Edwards
Surviving Your UX Career in Enterprise Design
2021 • Enterprise Community
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis
2020 • Enterprise Community
Benjamin Real
Maturity Models: A Core Tool for Creating a DesignOps Strategy
2021 • DesignOps Summit 2021
Gold
Jennifer Kong
Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold
Prayag Narula
HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
2023 • Advancing Research 2023
Gold
Alla Weinberg
How to Build and Scale Team Safety
2024 • DesignOps Summit 2020
Gold
Libby Maurer
Treating Diversity & Inclusion in Hiring as a Design Problem
2019 • Enterprise Community
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Chris Moses
Stretching the Definition of DesignOps with Product Development
2018 • DesignOps Summit 2018
Gold
Charlotte Lee
Theme 1 Intro
2021 • Civic Design 2021
Gold
Joseph Williams
Unlocking impact and influence through inclusive hiring in research
2021 • Advancing Research Community
Frances Yllana
D.E.A.R.R. Diaries (Discipline, Experience, Architecture, Reflection + Revolution)
2022 • Civic Design 2022
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Sara Asche Anderson
Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
2024 • Enterprise Experience 2020
Gold
Laine Riley Prokay
Carving a Path for Early Career DesignOps Practitioners
2022 • DesignOps Summit 2022
Gold

More Videos

Bud Caddell

"We want to prevent our community from the dehumanizing impulses often brought on by bureaucratic scaling."

Bud Caddell Kristin Skinner Alana Washington

DesignOps Community Sensing Session

May 13, 2021

Shipra Kayan

"We pivoted big parts of our weekly all-hands to just personal connection because work stuff can happen anytime."

Shipra Kayan Tess Dixon

How Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro 

October 1, 2021

Bria Alexander

"If you ever feel unsafe or threatened in this virtual community, we want to make sure you’ve got the support you need."

Bria Alexander

Opening Remarks

September 29, 2021

John Maeda

"Design tooling has stayed old too long, with many designers still clinging to Photoshop from 10 years ago."

John Maeda Alison Rand

About Design Organizations

May 13, 2019

Kate Kalcevich

"For people who identify as autistic, AI tools that review writing tone can be especially helpful."

Kate Kalcevich

Designing inclusively with AI

June 5, 2024

Frank Duran

"Lead with the ask, lead with the value, so people understand what you’re looking for from the start."

Frank Duran

Partnership Playbook: Lessons Learned in Effective Partnership

January 8, 2024

Kristin Taylor

"A service must not unnecessarily expose a user to the internal structures of the organization providing the service."

Kristin Taylor

Building Bridges Across Organizational Silos

November 18, 2022

Maria Giudice

"What doesn’t kill you will only make you stronger."

Maria Giudice

Empowering change: Reigniting purpose, passion and impact in research

March 13, 2025

Shelby Switzer

"Persisting conversations in Slack instead of Zoom chat means folks can revisit and join conversations asynchronously."

Shelby Switzer

Making Space for Community Knowledge-sharing in a Distributed World

December 10, 2021