Rosenverse
When AI Agents Meet Reality. Service Design Lessons from a Pilot

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

When AI Agents Meet Reality. Service Design Lessons from a Pilot

Thursday, February 26, 2026 • Rosenfeld Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
When AI Agents Meet Reality. Service Design Lessons from a Pilot
Speakers: Tina Weisser
Link:

Summary

Why does the introduction of AI agents so often lead to confusion instead of clarity? Drawing on an applied pilot project on Human-Agent Teams, this session shares key learnings from integrating AI agents into everyday work. The focus is not on the technology itself, but on structure. How roles shift. Where decisions get stuck. How trust is shaped or undermined. And why teams struggle even when the system technically works.
The session shows how Service Design helped make these dynamics visible and manageable. Not as a creativity method, but as a way to design clear responsibility, decision paths, and collaboration between humans and agents. Presentation and discussion.

Key Insights

  • •

    Agentic AI represents a shift from AI as a tool to AI as autonomous collaborators that run background workflows.

  • •

    Many organizations have AI agents built, but a large gap remains in making them truly helpful and valuable.

  • •

    Service design methods like process blueprints and human-in-the-loop approaches are key to designing effective AI-human workflows.

  • •

    Building AI agents quickly is easy, but identifying where they add value requires deep problem understanding and organizational context.

  • •

    Chaos in undocumented or inconsistent workflows complicates designing useful AI workflows.

  • •

    Trust and responsibility must remain human-led with clear definitions of when and how humans intervene in AI processes.

  • •

    Organizational power dynamics around information sharing critically impact the effectiveness of AI agent deployment.

  • •

    Iterative quality feedback loops where AI agents improve based on continuous human input are vital for success.

  • •

    Co-creative, multidisciplinary engagement including non-technical stakeholders increases adoption and reduces resistance to AI.

  • •

    AI literacy at all organizational levels is necessary; leaders must engage with AI to properly support teams using it.

Notable Quotes

"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."

"Lots of people have agents running, but they don't feel they’re really useful yet."

"It’s not about pure automation. It's like playing tennis—back and forth between human and agent."

"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."

"If you spend more time building an agent than doing the task, it’s not worth it."

"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."

"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."

"It’s dangerous to believe everything AI says or to believe nothing. We must find a balance."

"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."

"If we don't do hard thinking and critical collaboration when building agents, we’ll end up with armies of unused agents."

Ask the Rosenbot
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Kritika Sony
Moving AI offscreen: Exploring failures, constraints, and recovery in physical game design
2026 • Designing with AI 2026
Gold
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Sol Mesz
Hands or Brains? How to Hire for Strategy, Strategically
2024 • Enterprise Experience 2020
Gold
Julie Gitlin
Design as an Agent of Digital Transformation at JPMC
2021 • Design at Scale 2021
Gold
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold
Erin Weigel
Real-world lessons to improve your conversion rates
2024 • Rosenfeld Community
Andy Polaine
What is the role of service design in product-led organizations?
2024 • Advancing Service Design 2024
Gold
Erin May
Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
2022 • Advancing Research 2022
Gold
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Dana Bishop
2022: The Year UX Demonstrates its Business Impact
2022 • Advancing Research 2022
Gold
Onur Kocan
Understanding the Strategy for Civic Design in a Complex City: Istanbul
2022 • Civic Design 2022
Gold
Ariel Kennan
Theme Two Intro
2022 • Civic Design 2022
Gold
Tim Frick
The journey of building a sustainable design practice
2025 • Climate UX Interest Group
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold

More Videos

Dr. Karl Jeffries

"I was talking with a person who said I’m like an idea machine, a 24-7 idea machine. The reply was immediate. It isn’t, you get used up and spat out."

Dr. Karl Jeffries

The Science of Creativity for DesignOps

January 8, 2024

Amy Marquez

"We use Alexa’s personification for good, fun, and delight, but we don’t advertise, especially because there may be kids listening."

Amy Marquez

INVEST: Discussion

June 15, 2018

Steve Portigal

"Both tribes really believe in doing awesome for customers, that’s our common ground."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Alicia Mooty

"Splitting people’s allocation across different teams created work-life balance issues requiring more oversight."

Alicia Mooty

Design Staffing Models

September 30, 2021

Ana Maria Montero Barrantes

"For the right audience, if applied correctly, humor and music can move people in many ways."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Lada Gorlenko

"We can’t complain about not having a seat at the table if we don’t offer one of our own."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Sofia Quintero

"Choosing a research repository is a big battle in your organization; the right decisions can really help you succeed."

Sofia Quintero

The Product Philosophy Behind EnjoyHQ

March 10, 2021

Laura Klein

"Lawyers, though nervous, can become some of the most reasonable people you deal with if you explain risks clearly."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Andrew Michael

"At Hotcho, we started with a qualitative focus, swung too far into quantitative, and then found a balanced middle ground."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Latest Books All books