Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

AI of the now: Designing for Agents
Wednesday, July 31, 2024 • Rosenfeld Community
Share the love for this talk
AI of the now: Designing for Agents
Speakers: Christopher Noessel
Link:

Summary

AI agents are on the rise: people are talking about them, getting excited, and putting infrastructure into place to support them. You may be asked to design agents soon—or you may want to think through your product as an agent in order to get a leg up on your competition. What’s different about designing for agents? Are you ready? Rosenfeld author Christopher Noessel published Designing Agentive Technology back in 2017, and it seems like the world is just now catching up. Join Chris as he recaps the core ideas from that book, how agents have evolved since publication, and what it all might mean since the explosion of generative AI. Takeaways include… What is an agent? How do agents differ and complement other modes of interaction? Why are people getting excited about it now? What does generative AI bring to the agentive table?

Key Insights

  • Agents act on behalf of principals, whether humans, animals, or machines, performing tasks with variable human attention involvement.

  • Agentive technology operates largely outside the user's attention, unlike assistants that require active engagement.

  • Chris identified 27 unique agent use cases including setup, monitoring, handoff, and disengagement.

  • There are four modes of agency: manual, assistant, automation, and agentive, depending on who performs the work.

  • Agentive systems don’t require an agentic backend, and agentic backends can exist without agentive front-ends.

  • Recent AI advances use an 'agentic backend' architecture where a large language model orchestrates specialized agents for complex tasks.

  • Design challenges include enabling user control over agent plans, forbidding specific data sources, and handling persistent queries.

  • AI risks include deskilling users, overreliance on AI output, and ethical concerns from hidden, biased, or commercialized agentic actions.

  • Agents hold huge value potential by performing work outside users’ limited attention, making them a strong business opportunity.

  • Despite a rise in AI backend engineering, design is essential to maintain usefulness and address human-AI interaction complexities.

Notable Quotes

"An agent is anything that displays agency, the ability to take actions and choose which actions to take."

"I don’t want a surgeon to tap me on the shoulder and ask where to put the incision; that’s their expertise."

"My Roomba vacuums while I’m at work. It does its work out of my attention."

"We’ve been dealing with assistance since spellcheckers in the 1970s evolved to grammar checkers and beyond."

"The user might want to see that plan in advance and make sure they’re okay with how it’s going to go about it."

"Large language models sometimes hallucinate, so agentic backends assign sub-tasks to specialized expert agents."

"Agents do work outside the user's attention, freeing up their limited time for other activities."

"We risk deskilling users and overreliance, where people rubber stamp AI output without critical thought."

"Agentic systems could be hidden, allowing corporations to push self-interested biases undetected."

"AI should augment humans, not replace them, especially given societal disparities between deep and fast thinkers."

Ask the Rosenbot
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Christian Crumlish
Morning Insights Panel
2022 • Design in Product 2022
Gold
Tim Frick
The journey of building a sustainable design practice
2025 • Climate UX Interest Group
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Vitorio Miliano
Don’t call it AI: Turn words into numbers with quantitative ethnography
2026 • Advancing Research 2026
Conference
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Jon Fukuda
Theme 3 Intro
2024 • DesignOps Summit 2024
Gold
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold

More Videos

Louis Rosenfeld

"Don’t be afraid to poke the bear; controversy can help make your talk stand out and provoke meaningful discussion."

Louis Rosenfeld Jemma Ahmed Christian Crumlish Uday Gajendar Chris Geison

Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?

May 2, 2024

Jilanna Wilson

"Nothing builds collaborative relationships better than being physically present, so we make annual off-sites a priority."

Jilanna Wilson

Distributed Design Operations Management

October 23, 2019

Matt Webb

"Mini apps might not be useful for you, but they are for someone, and now those people can have them."

Matt Webb

Context Window: Five Futures for AI

June 11, 2025

Sam Proulx

"When you design for the edges, you get the middle for free."

Sam Proulx

Accessibility: An Opportunity to Innovate

September 8, 2022

Theresa Neil

"You don’t need an MD or PhD to be effective in healthcare UX; humility, curiosity, and preparation are essential."

Theresa Neil

Designing for Wellness: Specializing in Healthcare

May 22, 2024

Peter Van Dijck

"One of the biggest problems in AI building is evolving your prompts and having a fast feedback loop."

Peter Van Dijck

Hands-on AI #2: Understanding evals: LLM as a Judge

October 15, 2025

Rachel Posman

"Designers deserve support and infrastructure so they can really excel in their work."

Rachel Posman John Calhoun

"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors

September 25, 2024

Tricia Wang

"Companies parachuting in to 'study' marginalized groups often do more harm than good when they don't build local capacity."

Tricia Wang

The most popular design thinking strategy is BS

January 27, 2022

Sarah Auslander

"We are the problem we’re trying to replace — some legacy digital systems we created 20 years ago are still running."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022