Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

When AI Agents Meet Reality. Service Design Lessons from a Pilot
Thursday, February 26, 2026 • Rosenfeld Community
Share the love for this talk
When AI Agents Meet Reality. Service Design Lessons from a Pilot
Speakers: Tina Weisser
Link:

Summary

Why does the introduction of AI agents so often lead to confusion instead of clarity? Drawing on an applied pilot project on Human-Agent Teams, this session shares key learnings from integrating AI agents into everyday work. The focus is not on the technology itself, but on structure. How roles shift. Where decisions get stuck. How trust is shaped or undermined. And why teams struggle even when the system technically works. The session shows how Service Design helped make these dynamics visible and manageable. Not as a creativity method, but as a way to design clear responsibility, decision paths, and collaboration between humans and agents. Presentation and discussion.

Key Insights

  • Agentic AI represents a shift from AI as a tool to AI as autonomous collaborators that run background workflows.

  • Many organizations have AI agents built, but a large gap remains in making them truly helpful and valuable.

  • Service design methods like process blueprints and human-in-the-loop approaches are key to designing effective AI-human workflows.

  • Building AI agents quickly is easy, but identifying where they add value requires deep problem understanding and organizational context.

  • Chaos in undocumented or inconsistent workflows complicates designing useful AI workflows.

  • Trust and responsibility must remain human-led with clear definitions of when and how humans intervene in AI processes.

  • Organizational power dynamics around information sharing critically impact the effectiveness of AI agent deployment.

  • Iterative quality feedback loops where AI agents improve based on continuous human input are vital for success.

  • Co-creative, multidisciplinary engagement including non-technical stakeholders increases adoption and reduces resistance to AI.

  • AI literacy at all organizational levels is necessary; leaders must engage with AI to properly support teams using it.

Notable Quotes

"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."

"Lots of people have agents running, but they don't feel they’re really useful yet."

"It’s not about pure automation. It's like playing tennis—back and forth between human and agent."

"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."

"If you spend more time building an agent than doing the task, it’s not worth it."

"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."

"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."

"It’s dangerous to believe everything AI says or to believe nothing. We must find a balance."

"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."

"If we don't do hard thinking and critical collaboration when building agents, we’ll end up with armies of unused agents."

Ask the Rosenbot
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold
John Devanney
The Design Management Office
2017 • DesignOps Summit 2017
Gold
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps Summit 2024
Gold
Prayag Narula
Dialing for Research: How to Reach the Unreachable
2022 • Advancing Research 2022
Gold
Craig Villamor
Resilient Enterprise Design
2017 • Enterprise Experience 2017
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
Jorge Arango
Design as an Antidote to VUCA
2019 • Enterprise Community
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps Summit 2024
Gold
Aleksandra Korczynska
Survey Tools
2026 • Advancing Research 2026
Conference
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group

More Videos

Lada Gorlenko

"We can’t complain about not having a seat at the table if we don’t offer one of our own."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Mila Kuznetsova

"A growth mindset in research means being ready to adapt protocols based on what actually works with participants."

Mila Kuznetsova Lucy Denton

How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices

March 9, 2022

Jake Burghardt

"Insight summaries create durable knowledge that only goes away when it's been resolved or no longer relevant."

Jake Burghardt

Stop wasting research: Create new value with insight summaries

July 9, 2025

Liam Thurston

"Soft skills often are a multiplier on your hard skills—they’re just as valuable, if not more so."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022

Alexandra Schmidt

"User-centered design methods can be used at every stage of policy making, from intention setting to evaluation."

Alexandra Schmidt

Why Ethics Can't Save Tech

November 18, 2022

Renee Bouwens

"We’re capturing requirements usually without research, design has to be 100% baked before development starts."

Renee Bouwens

Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products

December 15, 2023

Bria Alexander

"It’s about us, the design ops practitioners, and what we need today to be better at our jobs."

Bria Alexander

Theme Two Intro

October 3, 2023

Steve Sanderson

"Just because you've been right in the past doesn't guarantee you'll be right in the future."

Steve Sanderson Alissa Briggs Jeff Gothelf Bill Scott

Discussion

May 14, 2015

Mary-Lynne Williams

"I couldn't be as good at this job if I hadn’t been in those leadership roles."

Mary-Lynne Williams

Exit Interview #4: From Product Design Leadership to Sound Healing

January 14, 2026