Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Heart and Brain of the AI Research

Gold
Tuesday, March 31, 2020 • Advancing Research 2020
Share the love for this talk
The Heart and Brain of the AI Research
Speakers: Liwei Dai
Link:

Summary

As a designer research working on Conversational AI products, I’ve been collaborating with AI Researchers (Computer Scientists) and ML engineers. The cross-pollination of our two research disciplines – i.e., I bring my design thinking, storytelling, qualitative research and thick data analysis lens, while the Computer Scientists bring their logical reasoning, modeling and coding, and big data analysis lens – has resulted in a much smarter and more empathetic AI product, as well as innovations in the Cognitive AI domain. I’ll share three use cases of how we human researchers collaborate with the AI researchers and the lessons learned.

Key Insights

  • UX research often stays on the surface of usability, missing deeper impacts related to data and AI models beneath the iceberg.

  • Natural language processing models require extensive and specific training data to understand diverse user utterances.

  • AI systems struggle to identify causality, often confusing correlation with cause and effect in user queries.

  • Users often engage in investigative dialogue before reaching their true question or desired outcome.

  • Human researchers can pinpoint why users interact with AI in unexpected ways by analyzing behavior beyond simple metrics like button clicks.

  • Collaboration between human researchers and AI scientists through shared observations and joint sense-making enhances AI development.

  • AI planning, such as the monkey and banana problem, offers a framework connecting user goals with efficient AI action sequences.

  • Human-centered research can inform training data selection, helping AI models to better predict and respond to user needs.

  • Effective AI product research requires understanding the technology enough to communicate meaningfully with technical teams.

  • Human researchers increase impact by shifting from passive observers to active participants in ideation, design, and strategy discussions.

Notable Quotes

"After more than 10 years of doing UX research, I was still only working above the iceberg, focusing on the usability and feature level."

"Machines can identify correlation via association, but it’s extremely difficult for them to reason and identify causality."

"People don’t always get straight to their question; they might need to do some investigation first before they figure out what to ask."

"The AI planning monkey and banana problem made me question whether getting the bananas is really the end goal."

"By identifying the triggers that lead customers to ask questions, I helped data scientists figure out what training data to explore."

"It’s not enough just sharing customer stories and insights; we need to get into the weeds and collaborate with product and tech partners."

"We need to be genuinely curious not just about our customers, but also about our colleagues and the technology behind AI."

"Our foundational interview, observation, and sense-making skills are evergreen and indispensable in the AI world."

"To be truly impactful, human researchers need to actively participate in product design sprints and strategy meetings."

"This emerging AI technology has given us a golden opportunity to combine the heart and brain of technology and make meaningful impact."

Ask the Rosenbot
Melissa Schmidt
How UX Research Hit It Big in Las Vegas
2019 • Enterprise Experience 2019
Gold
Josh Clark
Sentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
2025 • Rosenfeld Community
Mike Oren
Improving Democratized Research with CustomGPTs and Gems
2026 • Rosenfeld Community
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Sarah Fathallah
Beyond insights: Rethinking the role of researchers as stewards of organizational wisdom
2025 • Advancing Research 2025
Gold
Sara Conklin
Exit Interview: 20 Years of Tech, One Very Big Bet, and a Lot of Heat Pumps
2026 • Rosenfeld Community
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Megan Clegg
Space for Everyone: Reframing Accessibility Through a Wider Lens
2021 • Design at Scale 2021
Gold
Verónica Urzúa
The B-side of the Research Impact
2021 • Advancing Research 2021
Gold
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Weidan Li
Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
Louis Rosenfeld
GenAI for UXers: A Rosenbot Demo and Discussion
2025 • Designing with AI 2025
Gold
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Laura Klein
Unique challenges of innovation in enterprises
2020 • Enterprise Community
Janaki Kumar
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Benjamin Real
Maturity Models: A Core Tool for Creating a DesignOps Strategy
2021 • DesignOps Summit 2021
Gold

More Videos

Yunyan Li

"We encourage everyone to think big first then trim down based on priorities and keep a backlog of good ideas."

Yunyan Li Anna Le Jen Kim

UX Best Practices

June 11, 2021

Allan Lowson

"I felt this was a slippery slope—the blurring of lines between roles and responsibilities."

Allan Lowson

Rehashing the Double Diamond: Collaborating across functions with AI-assisted prototyping

June 9, 2026

Denise Jacobs

"I appreciate your allyship when I'm in the room, but I appreciate it more when I'm not in the room."

Denise Jacobs Nancy Douyon Renee Reid Lisa Welchman

Interactive Keynote: Social Change by Design

January 8, 2024

Renee Bouwens

"The sum is greater than the parts—how qualitative and quantitative research play together."

Renee Bouwens

Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products

December 15, 2023

Jemma Ahmed

"If you miss any one of these—access to data, insight generation, accuracy, engagement—it’s not truly democratization."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Sam Ladner

"I am swimming in a sea of information, like a little fish, and eating all the stuff."

Sam Ladner

How Research Can Drive Strategic Foresight

March 9, 2022

Yoel Sumitro

"Researchers were obsessed with scientific rigor while designers used balance, feelings, or intuition as their rigor."

Yoel Sumitro

Actions and Reflections: Bridging the Skills Gap among Researchers

March 9, 2022

Dave Hora

"Monitoring for weak signals and early signs of emergence is as important as intervention itself."

Dave Hora

Research in the Face of Complexity: New Sensibility for New Situations

August 27, 2025

Daniel J. Rosenberg

"Human beings understand graphical user interfaces as composed of objects and actions—this grammar is key to AI design."

Daniel J. Rosenberg

Designing with and for Artificial Intelligence

August 11, 2022