Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

When AI Agents Meet Reality. Service Design Lessons from a Pilot

Thursday, February 26, 2026 • Rosenfeld Community

This video is featured in the AI Trends in User Research playlist.

Share the love for this talk
When AI Agents Meet Reality. Service Design Lessons from a Pilot
Speakers: Tina Weisser
Link:

Summary

Why does the introduction of AI agents so often lead to confusion instead of clarity? Drawing on an applied pilot project on Human-Agent Teams, this session shares key learnings from integrating AI agents into everyday work. The focus is not on the technology itself, but on structure. How roles shift. Where decisions get stuck. How trust is shaped or undermined. And why teams struggle even when the system technically works. The session shows how Service Design helped make these dynamics visible and manageable. Not as a creativity method, but as a way to design clear responsibility, decision paths, and collaboration between humans and agents. Presentation and discussion.

Key Insights

  • Agentic AI represents a shift from AI as a tool to AI as autonomous collaborators that run background workflows.

  • Many organizations have AI agents built, but a large gap remains in making them truly helpful and valuable.

  • Service design methods like process blueprints and human-in-the-loop approaches are key to designing effective AI-human workflows.

  • Building AI agents quickly is easy, but identifying where they add value requires deep problem understanding and organizational context.

  • Chaos in undocumented or inconsistent workflows complicates designing useful AI workflows.

  • Trust and responsibility must remain human-led with clear definitions of when and how humans intervene in AI processes.

  • Organizational power dynamics around information sharing critically impact the effectiveness of AI agent deployment.

  • Iterative quality feedback loops where AI agents improve based on continuous human input are vital for success.

  • Co-creative, multidisciplinary engagement including non-technical stakeholders increases adoption and reduces resistance to AI.

  • AI literacy at all organizational levels is necessary; leaders must engage with AI to properly support teams using it.

Notable Quotes

"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."

"Lots of people have agents running, but they don't feel they’re really useful yet."

"It’s not about pure automation. It's like playing tennis—back and forth between human and agent."

"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."

"If you spend more time building an agent than doing the task, it’s not worth it."

"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."

"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."

"It’s dangerous to believe everything AI says or to believe nothing. We must find a balance."

"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."

"If we don't do hard thinking and critical collaboration when building agents, we’ll end up with armies of unused agents."

Ask the Rosenbot
Mariah Hay
Ethics in Tech Education: Designing to Provide Opportunity for All
2018 • Enterprise Experience 2018
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold
Ian Swinson
Designing and Driving UX Careers
2016 • Enterprise UX 2016
Gold
Suzan Bednarz
AccessibilityOps for All
2024 • DesignOps Summit 2020
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Libby Maurer
Treating Diversity & Inclusion in Hiring as a Design Problem
2019 • Enterprise Community
Maria Giudice
Becoming a Changemaker by Leading with Design
2023 • Advancing Research 2023
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Sara Asche Anderson
Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
2024 • Enterprise Experience 2020
Gold
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2017 • DesignOps Summit 2017
Gold
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Catherine Blizzard
Using Integrated Insight to Drive Growth
2022 • Advancing Research 2022
Gold

More Videos

Samuel Proulx

"We cannot remove barriers we aren’t aware of."

Samuel Proulx

Designing beyond caricatures: Embracing real, diverse user needs

December 4, 2024

Noel Lamb

"Legal impacts just about every aspect of research Ops, from GDPR to incentives to internal documentation."

Noel Lamb

Cultivating Business Partnerships to Grow Research Ops

March 21, 2022

Nathan Curtis

"Acquisition integration shouldn’t start with migration analysis but with engaging brand teams first."

Nathan Curtis

Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough?

January 17, 2019

Megan Blocker

"You can be an amazing researcher and have zero impact, or a bad researcher and have amazing impact."

Megan Blocker Mujtaba Hameed Victor Udoewa

Panel: Excellence in Impact

March 25, 2024

Peter Van Dijck

"Despite the worst user interface ever, cloud code is the most popular and successful agent that exists today."

Peter Van Dijck

Hands on AI #3: Claude Code for UX people

October 22, 2025

Ivana Ng

"Every successful enterprise has operational functions responsible for better collaboration, increased output, more efficiencies, and higher visibility."

Ivana Ng

Level Up Your Program with ProductOps

January 8, 2024

Catherine Courage

"Building trust and credibility was more important than immediately overhauling products."

Catherine Courage

The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead

May 13, 2015

Sabrina Mach

"Customer value outcomes should drive empowered product teams rather than technical outputs or budgets."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

"Curiosity and asking lots of questions helps push boundaries and improve solutions."

Product and Design at Bloomberg: A 15-year Evolution

December 6, 2022