Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Heart and Brain of the AI Research
Gold
Tuesday, March 31, 2020 • Advancing Research 2020
Share the love for this talk
The Heart and Brain of the AI Research
Speakers: Liwei Dai
Link:

Summary

As a designer research working on Conversational AI products, I’ve been collaborating with AI Researchers (Computer Scientists) and ML engineers. The cross-pollination of our two research disciplines – i.e., I bring my design thinking, storytelling, qualitative research and thick data analysis lens, while the Computer Scientists bring their logical reasoning, modeling and coding, and big data analysis lens – has resulted in a much smarter and more empathetic AI product, as well as innovations in the Cognitive AI domain. I’ll share three use cases of how we human researchers collaborate with the AI researchers and the lessons learned.

Key Insights

  • UX research often stays on the surface of usability, missing deeper impacts related to data and AI models beneath the iceberg.

  • Natural language processing models require extensive and specific training data to understand diverse user utterances.

  • AI systems struggle to identify causality, often confusing correlation with cause and effect in user queries.

  • Users often engage in investigative dialogue before reaching their true question or desired outcome.

  • Human researchers can pinpoint why users interact with AI in unexpected ways by analyzing behavior beyond simple metrics like button clicks.

  • Collaboration between human researchers and AI scientists through shared observations and joint sense-making enhances AI development.

  • AI planning, such as the monkey and banana problem, offers a framework connecting user goals with efficient AI action sequences.

  • Human-centered research can inform training data selection, helping AI models to better predict and respond to user needs.

  • Effective AI product research requires understanding the technology enough to communicate meaningfully with technical teams.

  • Human researchers increase impact by shifting from passive observers to active participants in ideation, design, and strategy discussions.

Notable Quotes

"After more than 10 years of doing UX research, I was still only working above the iceberg, focusing on the usability and feature level."

"Machines can identify correlation via association, but it’s extremely difficult for them to reason and identify causality."

"People don’t always get straight to their question; they might need to do some investigation first before they figure out what to ask."

"The AI planning monkey and banana problem made me question whether getting the bananas is really the end goal."

"By identifying the triggers that lead customers to ask questions, I helped data scientists figure out what training data to explore."

"It’s not enough just sharing customer stories and insights; we need to get into the weeds and collaborate with product and tech partners."

"We need to be genuinely curious not just about our customers, but also about our colleagues and the technology behind AI."

"Our foundational interview, observation, and sense-making skills are evergreen and indispensable in the AI world."

"To be truly impactful, human researchers need to actively participate in product design sprints and strategy meetings."

"This emerging AI technology has given us a golden opportunity to combine the heart and brain of technology and make meaningful impact."

Ask the Rosenbot
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Gold
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
Uday Gajendar
Theme 1: Introduction
2021 • Design at Scale 2021
Gold
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Dr. Nikki Smith
Research Strategy: Connecting Insights to Outcomes
2025 • Advancing Research 2025
Gold
Jon Temple
Panel: Stacks, Security, and Stakeholders: The Hidden Work of UXR Tool Procurement
2026 • Advancing Research 2026
Conference
Kit Unger
Theme 2: Discussion
2024 • Enterprise Experience 2020
Gold
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Holly Cole
Panel Discussion: Growing People and Teams
2018 • DesignOps Summit 2018
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
Laureen Kattan
Centering Patients and Clinicians in a Complex Government Ecosystem
2023 • Design in Product 2023
Gold
Billy Carlson
Tips to Utilize Wireframes to Tell an Effective Product Story
2023 • Enterprise UX 2023
Gold

More Videos

Kit Unger

"Sometimes it might be seen as something that is not necessary because our end users are practically colleagues, not actually paying customers."

Kit Unger Jackie Ho Veevi Rosenstein Vasileios Xanthopoulos

Theme 2: Discussion

January 8, 2024

Mariesa Lenz

"Teams can thrive when iteration and responsiveness are normalized and psychological safety is present."

Mariesa Lenz

What Beekeeping Taught me about Product Teams

October 29, 2025

Jesse Zolna

"We called it 'Come See For Yourself' — kind of like following me home, but slightly less creepy."

Jesse Zolna

Inviting the Whole Org to Come See For Yourself

March 30, 2020

Catt Small

"Building influence has been such a challenging part of growing in my own career. It takes a lot of communication and understanding others’ goals."

Catt Small Micah Bennett Brian Carr Jessica Harllee

What's Next for ICs: Exploring Staff and Principal Designer Roles

February 22, 2024

Louis Rosenfeld

"We haven’t put any client data into generative AI — just information about our own organization and processes."

Louis Rosenfeld Billy Carlson Jon Fukuda Maria Taylor

How AI will Change DesignOps Tooling

October 3, 2023

Sheryl Cababa

"Systems thinking is not just about complexity but grounded in ethics to help deliver a better future for humans and the planet."

Sheryl Cababa

Expanding your Design Lens with Systems Thinking

March 28, 2023

Saara Kamppari-Miller

"If you only measure vanity metrics like downloads, you risk tracking numbers that don’t translate to real usage or value."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

John Devanney

"Learning and knowledge management isn’t just about quality of work, it’s deeply tied to retaining people and motivation."

John Devanney

The Design Management Office

November 6, 2017

Erika Flowers

"We put high-fidelity designs in Mural so stakeholders unfamiliar with Figma can still comment and interact."

Erika Flowers

Introduction to MURAL for UX

June 11, 2021