Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

AI of the now: Designing for Agents
Wednesday, July 31, 2024 • Rosenfeld Community
Share the love for this talk
AI of the now: Designing for Agents
Speakers: Christopher Noessel
Link:

Summary

AI agents are on the rise: people are talking about them, getting excited, and putting infrastructure into place to support them. You may be asked to design agents soon—or you may want to think through your product as an agent in order to get a leg up on your competition. What’s different about designing for agents? Are you ready? Rosenfeld author Christopher Noessel published Designing Agentive Technology back in 2017, and it seems like the world is just now catching up. Join Chris as he recaps the core ideas from that book, how agents have evolved since publication, and what it all might mean since the explosion of generative AI. Takeaways include… What is an agent? How do agents differ and complement other modes of interaction? Why are people getting excited about it now? What does generative AI bring to the agentive table?

Key Insights

  • Agents act on behalf of principals, whether humans, animals, or machines, performing tasks with variable human attention involvement.

  • Agentive technology operates largely outside the user's attention, unlike assistants that require active engagement.

  • Chris identified 27 unique agent use cases including setup, monitoring, handoff, and disengagement.

  • There are four modes of agency: manual, assistant, automation, and agentive, depending on who performs the work.

  • Agentive systems don’t require an agentic backend, and agentic backends can exist without agentive front-ends.

  • Recent AI advances use an 'agentic backend' architecture where a large language model orchestrates specialized agents for complex tasks.

  • Design challenges include enabling user control over agent plans, forbidding specific data sources, and handling persistent queries.

  • AI risks include deskilling users, overreliance on AI output, and ethical concerns from hidden, biased, or commercialized agentic actions.

  • Agents hold huge value potential by performing work outside users’ limited attention, making them a strong business opportunity.

  • Despite a rise in AI backend engineering, design is essential to maintain usefulness and address human-AI interaction complexities.

Notable Quotes

"An agent is anything that displays agency, the ability to take actions and choose which actions to take."

"I don’t want a surgeon to tap me on the shoulder and ask where to put the incision; that’s their expertise."

"My Roomba vacuums while I’m at work. It does its work out of my attention."

"We’ve been dealing with assistance since spellcheckers in the 1970s evolved to grammar checkers and beyond."

"The user might want to see that plan in advance and make sure they’re okay with how it’s going to go about it."

"Large language models sometimes hallucinate, so agentic backends assign sub-tasks to specialized expert agents."

"Agents do work outside the user's attention, freeing up their limited time for other activities."

"We risk deskilling users and overreliance, where people rubber stamp AI output without critical thought."

"Agentic systems could be hidden, allowing corporations to push self-interested biases undetected."

"AI should augment humans, not replace them, especially given societal disparities between deep and fast thinkers."

Ask the Rosenbot
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Changying (Z) Zheng
Navigating Innovation with Integrity
2024 • DesignOps Summit 2024
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Community
Peter Van Dijck
Designing AI-first products on top of a rapidly evolving technology
2025 • Designing with AI 2025
Gold
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Jilanna Wilson
Distributed Design Operations Management
2019 • DesignOps Summit 2019
Gold
Tutti Taygerly
Videconference: How to Work with Difficult People with Tutti Taygerly
2020 • Enterprise Community
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Louis Rosenfeld
Opening Remarks
2023 • Advancing Research 2023
Gold
Aras Bilgen
Research Democratization: A Debate
2023 • Advancing Research 2023
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Advancing Research 2022
Gold
Dan Donald
Design Systems as a Vehicle for Systemic Change
2023 • DesignOps Community

More Videos

Carol Scott

"Retraumatization means when someone is reminded of a trauma, they relive it all over again as if it was happening in that exact moment."

Carol Scott Melissa Eggleston

Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices

February 5, 2025

Lija Hogan

"UX researchers should learn Python or R and how to leverage AI APIs to process unstructured data."

Lija Hogan Milan Mijatovic Sam Proulx Louis Rosenfeld

Three Years Out: Perspectives on the Near-Term Future of User Research

March 15, 2024

Sam Proulx

"Every app built into my phone is perfect when it comes to accessibility – Apple and Android set a strong example."

Sam Proulx

Mobile Accessibility and You

June 9, 2022

Ana Ferreira

"We evaluate the work and not the amount of hours."

Ana Ferreira

Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries

January 8, 2024

Jorge Arango

"The best way to understand these technologies is to learn them hands-on, especially if your work involves language or taxonomies."

Jorge Arango

Scale Smart: AI-Powered Content Organization Strategies

September 24, 2024

Chris Moses

"We’re an older company by tech standards—older than Facebook, Twitter, LinkedIn, and even Google by one year."

Chris Moses

Stretching the Definition of DesignOps with Product Development

November 7, 2018

Trisha Causley

"Even though we’ve got a single dropdown field, it maps to a far richer set of instructions in the prompt."

Trisha Causley

[Demo] Complexity in disguise: Crafting experiences for generative AI features

June 5, 2024

Clara Kliman-Silver

"Trust is paramount; designers want transparency about what the AI is trained on and what data it uses."

Clara Kliman-Silver

UX Futures: The Role of Artificial Intelligence in Design

June 7, 2023

Michael Polivka

"Not a single person on this relationship map reported to me. That’s how I affect design at scale at Autodesk."

Michael Polivka

Scaling Design through Relationship Maps

November 7, 2017