Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Designing Within the Lines: How the EU AI Act Can Spark Better AI Innovation
Summary
Are you building or using AI in your products? Do you have customers in the EU, or plan to? If so, the EU AI Act isn’t just another piece of legislation. It’s a blueprint for the future of digital product design, a signal of where responsible, human-centered technology is headed. As the world’s first comprehensive AI law, the Act sets new expectations for trust, transparency, and accountability. And it doesn’t matter whether your team is in San Francisco, Singapore, or Sydney: if you build or use AI, this shift affects you. Let’s stop treating AI like a race, and start seeing it as a design challenge: how to build products that people trust, adopt, and keep using. From chatbots to recommendation engines, every AI-powered experience will soon need to meet standards for safety, explainability, and fairness. But this isn’t only about compliance. It’s about turning responsibility into a competitive edge, building systems that last, and products that lead. In this session, we’ll unpack what the EU AI Act means for design, product, and operations leaders, in plain language, no legal jargon required. You’ll walk away understanding: - How AI systems are classified and why “high risk” might apply to your product even if you’re not in the EU - Why transparency, documentation, and human oversight are becoming core design principles - How acting early can strengthen user trust, reduce risk, and set your team apart - How design and product roles are evolving and why that shift is an opportunity, not a threat This isn’t about avoiding fines. It’s about leading with integrity, designing technology people believe in, and using regulation as a launchpad for innovation. Whether you’re a designer, product manager, or operations leader, this session will help you understand what’s changing, take action now, and turn the EU AI Act into your next innovation catalyst.
Key Insights
-
•
The EU AI Act introduces penalties up to 35 million euros or 7% of global turnover for non-compliance, affecting any company serving European customers.
-
•
AI is agency with impact, not just a tool; it can make decisions dramatically affecting human lives.
-
•
Transparency and accountability are core to the AI Act, requiring detailed documentation and auditable logs of all AI decisions, preserved for up to 10 years.
-
•
High-risk AI systems, such as those used in healthcare or hiring, require bias testing, human oversight, and clear escalation paths.
-
•
Many current AI systems cannot be retrofitted to comply, making early compliance and documentation essential.
-
•
Chatbots are generally low or limited risk but become high risk if their decisions significantly impact humans, such as insurance claims denial.
-
•
Synthetic content generated or altered by AI must be persistently labeled as such to maintain transparency for users and auditors.
-
•
Human oversight must prevail in AI interactions; humans retain accountability and must be able to override AI decisions.
-
•
Designers need to create flows that embed human control, transparency, and accountability, moving beyond traditional user flows to 'agent flows' managing AI interactions.
-
•
Organizations should map their AI systems, classify risk levels, assign responsibility, and prioritize compliance as part of their product strategies.
Notable Quotes
"The AI Act can spark better innovation with AI rather than constraining it."
"Speed is not everything we need velocity—speed plus direction is key."
"AI is not a tool. AI has agency. AI makes decisions that impact people's lives."
"Machines cannot be accountable; responsibility is always human."
"If you are building or deploying AI that impacts people, you need to document everything."
"Transparency requires all decisions to be clear and understandable to non-technical users."
"Humans need to override and dominate AI because machines have no context or experience."
"Most AI systems today cannot be retrofitted easily to comply with regulation."
"Everything touched by AI becomes synthetic and needs persistent labeling."
"Real innovation is not being first; it's about doing it right and sustainably."
Or choose a question:
More Videos
"You need to show up as humans first before we show up as employees."
Sahibzada Mayed Lauren LinCultivating Design Ecologies of Care, Community, and Collaboration
October 4, 2023
"When you put in that effort, you’re going to get the advocacy not only from your team but within the organization."
Frank DuranPartnership Playbook: Lessons Learned in Effective Partnership
January 8, 2024
"People in some countries are three times more likely to buy a product if it’s localized in their language."
Nancy DouyonWe'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
June 15, 2018
"We want to develop a civic design methodology compatible with Istanbul’s current conditions."
Onur Kocan Ayhan EnsiciUnderstanding the Strategy for Civic Design in a Complex City: Istanbul
November 16, 2022
"We were like islands with no bridges, trying to connect while remote, but it wasn’t so easy."
Rusha SopariwalaRemote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
June 9, 2022
"All models are wrong, but some are useful."
Scott PlewesWhy Isn't Your UX Approach Going Viral?: A Mathematical Model
March 28, 2023
"It is very easy to tick all the accessibility checkboxes and still have a poor, ugly, and unhelpful product."
Sam ProulxAccessibility: An Opportunity to Innovate
September 8, 2022
"Rolling out a research repository is complex but crucial to avoid duplicate research and make insights discoverable."
Michelle Bejian Lotia Anne-Marie MorellRolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
March 28, 2023
"Facilitation is essential—not just for design work but to build alignment and manage people."
Amy Jiménez Márquez Michael J. Metts Joie ChungThe Atypical UX Manager Path
July 23, 2020
Latest Books All books
Dig deeper with the Rosenbot
Why is design education’s emphasis on critical making important, and how does it interrelate with critique and theory?
How do cultural beliefs and stories influence maternal health practices and care outcomes?
How does Survicate's use of AI-powered prototypes relate to the Wizard of Oz research method?