Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

When AI Agents Meet Reality. Service Design Lessons from a Pilot

Thursday, February 26, 2026 • Rosenfeld Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
When AI Agents Meet Reality. Service Design Lessons from a Pilot
Speakers: Tina Weisser
Link:

Summary

Why does the introduction of AI agents so often lead to confusion instead of clarity? Drawing on an applied pilot project on Human-Agent Teams, this session shares key learnings from integrating AI agents into everyday work. The focus is not on the technology itself, but on structure. How roles shift. Where decisions get stuck. How trust is shaped or undermined. And why teams struggle even when the system technically works. The session shows how Service Design helped make these dynamics visible and manageable. Not as a creativity method, but as a way to design clear responsibility, decision paths, and collaboration between humans and agents. Presentation and discussion.

Key Insights

  • Agentic AI represents a shift from AI as a tool to AI as autonomous collaborators that run background workflows.

  • Many organizations have AI agents built, but a large gap remains in making them truly helpful and valuable.

  • Service design methods like process blueprints and human-in-the-loop approaches are key to designing effective AI-human workflows.

  • Building AI agents quickly is easy, but identifying where they add value requires deep problem understanding and organizational context.

  • Chaos in undocumented or inconsistent workflows complicates designing useful AI workflows.

  • Trust and responsibility must remain human-led with clear definitions of when and how humans intervene in AI processes.

  • Organizational power dynamics around information sharing critically impact the effectiveness of AI agent deployment.

  • Iterative quality feedback loops where AI agents improve based on continuous human input are vital for success.

  • Co-creative, multidisciplinary engagement including non-technical stakeholders increases adoption and reduces resistance to AI.

  • AI literacy at all organizational levels is necessary; leaders must engage with AI to properly support teams using it.

Notable Quotes

"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."

"Lots of people have agents running, but they don't feel they’re really useful yet."

"It’s not about pure automation. It's like playing tennis—back and forth between human and agent."

"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."

"If you spend more time building an agent than doing the task, it’s not worth it."

"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."

"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."

"It’s dangerous to believe everything AI says or to believe nothing. We must find a balance."

"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."

"If we don't do hard thinking and critical collaboration when building agents, we’ll end up with armies of unused agents."

Ask the Rosenbot
Todd Healy
Driving Change with CX Metrics
2023 • Enterprise UX 2023
Gold
Crystal Philcox
The Many Faces of Operations
2017 • DesignOps Summit 2017
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!
2025 • Rosenfeld Community
Brad Orego
Bringing Customer Research to More Internal Teams
2022 • Advancing Research 2022
Gold
Stefanie Owens
Optimizing for Outcomes: Transformation Design in Systems at Scale
2024 • Advancing Service Design 2024
Gold
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Sylvie Abookire
A Civic Designer's Guide to Mindful Conflict Navigation
2022 • Civic Design 2022
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Yulya Besplemennova
[Demo] Stress-testing GenAI in user research synthesis
2024 • Designing with AI 2024
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Chelsey Glasson
Exit Interview #3: Same as It Ever Was: What Leaving Tech Taught Me About Change
2025 • Rosenfeld Community
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Design at Scale 2022
Gold

More Videos

Bassel Deeb

"You ask yourself, does this activity directly impact the quality, feature, price, or customer experience?"

Bassel Deeb Will Osborn

Do More With Less: Equip and Lead Design Orgs Through Adversity

October 2, 2023

Sabrina Mach

"A false start means design is not considered first, leading to rework, cost loss, and product failure."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Anupama Dhareshwar

"Frontline staff should feel ownership, not fear, around AI implementation."

Anupama Dhareshwar

From blueprint to bot: Designing resilient AI-powered services

November 19, 2025

Neema Mahdavi

"No one just wakes up and decides to climb a mountain; every step is intentional and planned."

Neema Mahdavi

Operationalizing DesignOps

November 7, 2018

Lija Hogan

"Regulations are design problems, not just technical ones, influencing how we create products and experiences."

Lija Hogan Milan Mijatovic Sam Proulx Louis Rosenfeld

Three Years Out: Perspectives on the Near-Term Future of User Research

March 15, 2024

Maria Skaaden

"The starting point was a very technical one: please make the user experience exactly the same a year from now."

Maria Skaaden

Continuous Design: One eye on the horizon and the other on the next wave

November 8, 2018

Patrick Boehler

"Journalists experiencing the same trauma as samurai during the Meiji Restoration – once warriors, now unsure of their role."

Patrick Boehler Madison Karas

The service shift: transforming media organizations to create real value through design

November 19, 2025

Andy Polaine

"People are losing the grasp of the customer experience while UX teams are very strong."

Andy Polaine Lavrans Løvlie

What is the role of service design in product-led organizations?

December 3, 2024

Teresa Swingler

"What if flying was as easy as driving a car? That was our main question designing user interfaces."

Teresa Swingler

Look, Up in the Sky! UX/UI for Aerospace

October 27, 2022