Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Ask the Rosenbot
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Leisa Reichelt
Opening Keynote: Operating in Context
2018 • DesignOps Summit 2018
Gold
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Sol Mesz
Hands or Brains? How to Hire for Strategy, Strategically
2024 • Enterprise Experience 2020
Gold
Noreen Whysel
Short Take #4: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Enterprise Experience 2020
Gold
Mark Interrante
AI for Prioritization (3rd of 3 seminars)
2024 • Rosenfeld Community
Luke Roberts
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Robin Beers
Panel: Excellence in Communicating Insights
2024 • Advancing Research 2024
Gold
Josh Clark
Sentient Scenes and Radically Adaptive Experiences
2025 • Designing with AI 2025
Gold
Jemma Ahmed
Theme Panel
2025 • Advancing Research 2025
Gold
Holly Cole
Panel Discussion: Growing People and Teams
2018 • DesignOps Summit 2018
Gold
Alison Rand
Scaling Impact with Service Design
2021 • DesignOps Community
Megan Blocker
What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Marc Fonteijn
Increase your confidence, influence, and impact (through a Professional Community)
2024 • Advancing Service Design 2024
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold

More Videos

Farid Sabitov

"Dynamic permission management and turning on SSO or SIEM help manage tools at scale without nano work."

Farid Sabitov

Theme Four Intro

September 9, 2022

Wyatt Hayman

"Our research operations team’s mission is to let researchers focus on research without worrying about operational details."

Wyatt Hayman

Global Research Panels

August 8, 2020

Lisanne Norman

"The best job I ever had was with those two female VPs who believed in me and gave me a chance."

Lisanne Norman

Why I Left Research

March 27, 2023

Weidan Li

"Using analogy is very difficult for AI because it requires a unique human ability to connect and engage through storytelling."

Weidan Li

Qualitative synthesis with ChatGPT: Better or worse than human intelligence?

June 4, 2024

Ariel Kennan

"I encourage you all to ask questions throughout the day and follow up with speakers and cohorts to go deeper."

Ariel Kennan

Theme 2 Intro

December 9, 2021

Christian Crumlish

"These bots will say yes to all your ideas, whether they're good or bad—that's the rocket to Mars anti-pattern."

Christian Crumlish

The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…

August 14, 2025

Joseph Meersman

"Design shares are more about presenting finished work and practice defending it, not about peer-to-peer feedback."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Russell Blair

"Designers are thrown into environments with experts that have decades of experience, and we have to come up with something relevant really quickly."

Russell Blair Milan Guenther

Killing the blank page

June 5, 2024

Liam Thurston

"If your team sees a clear path of mastery in your organization, they’re much more likely to stay."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022