Rosenverse
AI of the now: Designing for Agents

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

AI of the now: Designing for Agents

Wednesday, July 31, 2024 • Rosenfeld Community
Share the love for this talk
AI of the now: Designing for Agents
Speakers: Christopher Noessel
Link:

Summary

AI agents are on the rise: people are talking about them, getting excited, and putting infrastructure into place to support them. You may be asked to design agents soon—or you may want to think through your product as an agent in order to get a leg up on your competition. What’s different about designing for agents? Are you ready? Rosenfeld author Christopher Noessel published Designing Agentive Technology back in 2017, and it seems like the world is just now catching up. Join Chris as he recaps the core ideas from that book, how agents have evolved since publication, and what it all might mean since the explosion of generative AI. Takeaways include… What is an agent? How do agents differ and complement other modes of interaction? Why are people getting excited about it now? What does generative AI bring to the agentive table?

Key Insights

  • Agents act on behalf of principals, whether humans, animals, or machines, performing tasks with variable human attention involvement.

  • Agentive technology operates largely outside the user's attention, unlike assistants that require active engagement.

  • Chris identified 27 unique agent use cases including setup, monitoring, handoff, and disengagement.

  • There are four modes of agency: manual, assistant, automation, and agentive, depending on who performs the work.

  • Agentive systems don’t require an agentic backend, and agentic backends can exist without agentive front-ends.

  • Recent AI advances use an 'agentic backend' architecture where a large language model orchestrates specialized agents for complex tasks.

  • Design challenges include enabling user control over agent plans, forbidding specific data sources, and handling persistent queries.

  • AI risks include deskilling users, overreliance on AI output, and ethical concerns from hidden, biased, or commercialized agentic actions.

  • Agents hold huge value potential by performing work outside users’ limited attention, making them a strong business opportunity.

  • Despite a rise in AI backend engineering, design is essential to maintain usefulness and address human-AI interaction complexities.

Notable Quotes

"An agent is anything that displays agency, the ability to take actions and choose which actions to take."

"I don’t want a surgeon to tap me on the shoulder and ask where to put the incision; that’s their expertise."

"My Roomba vacuums while I’m at work. It does its work out of my attention."

"We’ve been dealing with assistance since spellcheckers in the 1970s evolved to grammar checkers and beyond."

"The user might want to see that plan in advance and make sure they’re okay with how it’s going to go about it."

"Large language models sometimes hallucinate, so agentic backends assign sub-tasks to specialized expert agents."

"Agents do work outside the user's attention, freeing up their limited time for other activities."

"We risk deskilling users and overreliance, where people rubber stamp AI output without critical thought."

"Agentic systems could be hidden, allowing corporations to push self-interested biases undetected."

"AI should augment humans, not replace them, especially given societal disparities between deep and fast thinkers."

Ask the Rosenbot
Giff Constable
Financial fluency for product leaders: AMA with Giff Constable
2024 • Rosenfeld Community
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Shawna Hein
Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
2022 • Civic Design 2022
Gold
Shazia Ali
Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Katie Johnson
Disrupting generative AI products with just-in-time consumer insights
2024 • Designing with AI 2024
Gold
Laine Riley Prokay
Carving a Path for Early Career DesignOps Practitioners
2022 • DesignOps Summit 2022
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Lija Hogan
Three Years Out: Perspectives on the Near-Term Future of User Research
2024 • Advancing Research Community
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Josh Clark
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
2025 • Rosenfeld Community
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold

More Videos

Natalia Radywyl

"Nearly a third of the 65 mental health commission recommendations call for co-design, which is pretty exciting."

Natalia Radywyl

Co-Designing New Power in Australia's Public Sector

November 16, 2022

Aditi Ruiz

"We each bring different skills, temperaments, and interests, so there’s no one perfect relationship model between roles."

Aditi Ruiz Christian Crumlish Farid Sabitov

Pulse Check: Empathy Mapping Your Product Manager, Pt. 2

December 6, 2022

Sheryl Cababa

"If you’re working at scale, many problems that seem like 'clock' problems actually have 'cloud' elements."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023

Alba Villamil

"Using the umbrella term 'people of color' erases the most disadvantaged and privileges the least burdened."

Alba Villamil

Stereotyped by Design: Pitfalls in Cross-Cultural User Research

March 30, 2020

Scott Jensen

"They’re not living out the Judgment of Solomon every day, where the baby can be split in half."

Scott Jensen Sarah Delaney Carmen Liu

Short Take #2: UX/Product Lessons from Your Industry Peers

December 6, 2022

Randolph Duke II

"Carol was really grateful for our conversation."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020

Briana Thomas

"Our effectiveness scale measured audience, purpose, documentation, cadence, effectiveness, participation, and culture to rate meetings."

Briana Thomas Christina Rodriguez

When Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org

September 30, 2021

Saara Kamppari-Miller

"When we start being intentional about inclusion, we gain clarity in Design Ops."

Saara Kamppari-Miller

Theme Three Intro

September 9, 2022

Sam Proulx

"Confidence is critical in online shopping because nobody wants to spend money they’re unsure about losing due to unclear controls."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023