Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
Thursday, December 11, 2025 • DesignOps Community
Share the love for this talk
Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
Speakers: Patrizia Bertini
Link:

Summary

Are you building or using AI in your products? Do you have customers in the EU, or plan to? If so, the EU AI Act isn’t just another piece of legislation. It’s a blueprint for the future of digital product design, a signal of where responsible, human-centered technology is headed. As the world’s first comprehensive AI law, the Act sets new expectations for trust, transparency, and accountability. And it doesn’t matter whether your team is in San Francisco, Singapore, or Sydney: if you build or use AI, this shift affects you. Let’s stop treating AI like a race, and start seeing it as a design challenge: how to build products that people trust, adopt, and keep using. From chatbots to recommendation engines, every AI-powered experience will soon need to meet standards for safety, explainability, and fairness. But this isn’t only about compliance. It’s about turning responsibility into a competitive edge, building systems that last, and products that lead. In this session, we’ll unpack what the EU AI Act means for design, product, and operations leaders, in plain language, no legal jargon required. You’ll walk away understanding: - How AI systems are classified and why “high risk” might apply to your product even if you’re not in the EU - Why transparency, documentation, and human oversight are becoming core design principles - How acting early can strengthen user trust, reduce risk, and set your team apart - How design and product roles are evolving and why that shift is an opportunity, not a threat This isn’t about avoiding fines. It’s about leading with integrity, designing technology people believe in, and using regulation as a launchpad for innovation. Whether you’re a designer, product manager, or operations leader, this session will help you understand what’s changing, take action now, and turn the EU AI Act into your next innovation catalyst.

Key Insights

  • The EU AI Act introduces penalties up to 35 million euros or 7% of global turnover for non-compliance, affecting any company serving European customers.

  • AI is agency with impact, not just a tool; it can make decisions dramatically affecting human lives.

  • Transparency and accountability are core to the AI Act, requiring detailed documentation and auditable logs of all AI decisions, preserved for up to 10 years.

  • High-risk AI systems, such as those used in healthcare or hiring, require bias testing, human oversight, and clear escalation paths.

  • Many current AI systems cannot be retrofitted to comply, making early compliance and documentation essential.

  • Chatbots are generally low or limited risk but become high risk if their decisions significantly impact humans, such as insurance claims denial.

  • Synthetic content generated or altered by AI must be persistently labeled as such to maintain transparency for users and auditors.

  • Human oversight must prevail in AI interactions; humans retain accountability and must be able to override AI decisions.

  • Designers need to create flows that embed human control, transparency, and accountability, moving beyond traditional user flows to 'agent flows' managing AI interactions.

  • Organizations should map their AI systems, classify risk levels, assign responsibility, and prioritize compliance as part of their product strategies.

Notable Quotes

"The AI Act can spark better innovation with AI rather than constraining it."

"Speed is not everything we need velocity—speed plus direction is key."

"AI is not a tool. AI has agency. AI makes decisions that impact people's lives."

"Machines cannot be accountable; responsibility is always human."

"If you are building or deploying AI that impacts people, you need to document everything."

"Transparency requires all decisions to be clear and understandable to non-technical users."

"Humans need to override and dominate AI because machines have no context or experience."

"Most AI systems today cannot be retrofitted easily to comply with regulation."

"Everything touched by AI becomes synthetic and needs persistent labeling."

"Real innovation is not being first; it's about doing it right and sustainably."

Ask the Rosenbot
Ricardo Martins
Unlocking the power of advanced quantitative methods
2025 • Advancing Research 2025
Gold
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Adam Cutler
Discussion
2016 • Enterprise UX 2016
Gold
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Adrian Howard
Sturgeon’s Biases
2024 • DesignOps Summit 2024
Gold
Nick Lewis
Designing and building low-carbon websites independently
2025 • Climate UX Interest Group
Erin Hoffman-John
This Game is Never Done: Design Leadership Techniques from the Video Game World
2017 • DesignOps Summit 2017
Gold
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Matteo Gratton
Can Data and Ethics Live Together?
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Theme 1 Intro
2024 • DesignOps Summit 2024
Gold
Mila Kuznetsova
How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
2022 • Advancing Research 2022
Gold
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Lija Hogan
Contexts of Use: A Framework for Connection
2021 • Civic Design 2021
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
James Lang
If you can design an app, you can design a community
2025 • Rosenfeld Community

More Videos

Ian Johnson

"Similar inputs will produce similar high dimensional numbers."

Ian Johnson

Latent Scope: Finding structure in unstructured data

June 11, 2025

Sam Proulx

"Diverse teams build diverse products that work for more people."

Sam Proulx

Accessibility: An Opportunity to Innovate

September 8, 2022

Prayag Narula

"Observation reveals needs users themselves haven’t recognized yet."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022

John Cutler

"The estuary is highly resilient but also very sensitive to industrial waste—creative collaboration areas in organizations are similar."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Anna Avrekh

"Requesting glossy portfolios up front risks excluding candidates with strong problem-solving skills who may not have had opportunities to showcase visual design."

Anna Avrekh Amy Jiménez Márquez Morgan C. Ramsey Catarina Tsang

Diversity In and For Design: Building Conscious Diversity in Design and Research

June 9, 2021

Noz Urbina

"The vision is a super design assistant that talks to all your data systems, suggests content, writes proofs of concept, and puts tasks into Jira."

Noz Urbina

Rapid AI-powered UX (RAUX): A framework for empowering human designers

May 1, 2025

Greg Petroff

"The biggest security risk is human behavior, like plugging a USB stick into a copier, not nefarious hackers."

Greg Petroff

Everything is About to Change: Software as Material

June 8, 2016

Andy Polaine

"All of these things are connected and when they become too disconnected, it’s problematic."

Andy Polaine Lavrans Løvlie

What is the role of service design in product-led organizations?

December 3, 2024

Patrizia Bertini

"Your impact depends on strategic goals and context; without clarity, you won’t have the maximum impact."

Patrizia Bertini

DesignOps + KPIs = Measure your Impact!

January 8, 2024