Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Research in the Automated Future
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Research in the Automated Future
Speakers: Ovetta Sampson
Link:

Summary

Ovetta will talk with us about reinvigorating the practice by incorporating Design Anthropology into our research tool-kits and further broadening our set of methodologies to include new research methods for AI/ML design.

Key Insights

  • Design and research are tightly intertwined; it's often impossible to tell where one ends and the other begins.

  • Machine learning models primarily predict based on past data rather than interact dynamically with the environment.

  • Intelligent systems involve multi-agency contexts where both humans and machines have decision-making power.

  • Unlike static software, AI systems are dynamic, learning and evolving based on interactions and data.

  • Design research for AI must be future-focused and speculative, addressing not just usability but cultural values and trust.

  • Bias in AI is complex, involving mathematical, statistical, cognitive, and human biases requiring nuanced mitigation.

  • Researchers and designers need high AI and data literacy to influence data inputs and model fairness, not just outputs.

  • Explainability in AI is challenging, especially with neural networks, necessitating governance and 'glass box' approaches.

  • Design anthropology and participatory methods help uncover unspoken human practices important for automated systems.

  • Speculative prototypes (provocation prototypes) and perpetual synthesis support ongoing learning about future AI use.

Notable Quotes

"Design is the conscious and intuitive effort to impose meaningful order to chaos."

"Our role as designers and researchers will be to determine what not to design to preserve human culture and values."

"Machine learning models can see, hear, think, and act but are limited to problem-solving based on past observations."

"The relationship between a user and AI system is multi-agency; both have agency to act and influence outcomes."

"The nuance is the enemy of machine learning and AI; they struggle with ambiguity where humans thrive."

"Research for AI must go beyond single agency frameworks to consider complex ecosystems and multi-modal environments."

"It's not about looking under the hood of the model, but about what data goes into the hood that you can influence."

"There are many types of bias—mathematical, statistical, cognitive, human—and they affect AI outcomes differently."

"Explainability requires transparency at every stage with governance ensuring fairness and equity in model building."

"Speculative research requires participatory methods, putting people into future scenarios, because people often can't articulate what they will want."

Ask the Rosenbot
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold
Tricia Wang
From Users to Shapers of AI: The Future of Research
2024 • Advancing Research 2024
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How
2021 • Advancing Research Community
John Paul de Guzman
10k Screens Later: How We Became a Data-Driven Design Organization
2024 • DesignOps Summit 2024
Gold
Saara Kamppari-Miller
Theme Three Intro
2023 • DesignOps Summit 2023
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Erin Hauber
Design is Not the Frosting on the Scaled Agile Layer Cake
2019 • DesignOps Summit 2019
Gold
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Boon Yew Chew
Making Sense of Systems—and Using Systems to Make Sense of the Enterprise
2023 • Enterprise UX 2023
Gold
Megan Kierstead
You Are a Badass at UX: Overcoming Imposter Syndrome
2021 • Advancing Research 2021
Gold
Leisa Reichelt
The Five Dysfunctions of Democratized Research at Scale
2020 • Advancing Research 2020
Gold
Zariah Cameron
ReDesigning Wellbeing for Equitable Care in the Workplace
2024 • DesignOps Summit 2024
Gold
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group

More Videos

Louis Rosenfeld

"Newness isn’t necessarily a new methodology—it can be a new way of looking at something familiar."

Louis Rosenfeld Jemma Ahmed Christian Crumlish Uday Gajendar Chris Geison

Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?

May 2, 2024

Jilanna Wilson

"Emojis and GIFs have become effective tools for remote teams to add expression and prevent miscommunication."

Jilanna Wilson

Distributed Design Operations Management

October 23, 2019

Matt Webb

"What makes it different is that it doesn’t run sequentially; you give it a goal and it decides how to achieve it."

Matt Webb

Context Window: Five Futures for AI

June 11, 2025

Sam Proulx

"When you design for the edges, you get the middle for free."

Sam Proulx

Accessibility: An Opportunity to Innovate

September 8, 2022

Theresa Neil

"You aren't going to understand the healthcare ecosystem right off the bat; it’s incredibly complex."

Theresa Neil

Designing for Wellness: Specializing in Healthcare

May 22, 2024

Peter Van Dijck

"By starting to categorize risk in detail, you naturally lead to better prompts and better evals."

Peter Van Dijck

Hands-on AI #2: Understanding evals: LLM as a Judge

October 15, 2025

Rachel Posman

"Design ops and product ops are way more alike than dissimilar; they differ mainly in the orgs they serve."

Rachel Posman John Calhoun

"Ask Me Anything" with Rachel Posman and John Calhoun, Authors of the Upcoming Rosenfeld Book, The Design Conductors

September 25, 2024

Tricia Wang

"How might we has become like a church—untouchable and sanctimonious instead of a flexible tool."

Tricia Wang

The most popular design thinking strategy is BS

January 27, 2022

Sarah Auslander

"It’s a marathon not a sprint. Pace yourself and take care of yourself and the other runners around you."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022