Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Ask the Rosenbot
Chris Govias
Perspectives on Civic Design
2021 • Civic Design Community
Dave Gray
Liminal Thinking: Sense-making for systems in large organizations
2015 • Enterprise UX 2015
Gold
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Toby Haug
Discussion
2017 • Enterprise Experience 2017
Gold
Scher Foord
Turn the Ship Around: How to Apply Design Thinking Across Your Organization
2021 • Design at Scale 2021
Gold
Indra Klavins
A Design Ops Girl in a Dev Ops World
2019 • DesignOps Summit 2019
Gold
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Uday Gajendar
Theme 1: Introduction
2021 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Mackenzie Guinon
M.C. Escher’s UX Research Career Ladder
2022 • Advancing Research 2022
Gold
Husani Oakley
Bias Towards Action: Building Teams that Build Work
2018 • Enterprise Experience 2018
Gold
Sheryl Cababa
Day 2 Panel
2024 • Designing with AI 2024
Gold
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold
Jim Kalbach
Jobs To Be Done
2021 • Enterprise Community
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold

More Videos

Jackie Velasquez-Ross

"Recruiting can be tedious, but every interaction is a chance to show candidates you care."

Jackie Velasquez-Ross

Talent Acquisition and Our Responsibility

June 16, 2020

Amy Gawronski Zuccaro

"Bring the people who are blocking you into the process and have them see with their own eyes what you're doing."

Amy Gawronski Zuccaro

Advice for DesignOps Employee #1

September 29, 2021

Gabrielle Verderber

"Encourage adoption by sharing documentation in relevant channels, referring team members to it, and including it in onboarding."

Gabrielle Verderber

Documentation Your Team Will Actually Use

October 3, 2023

Louis Rosenfeld

"Silos were a problem then, and I have a feeling silos are still a problem today."

Louis Rosenfeld

Welcome / Housekeeping

June 6, 2023

Frances Yllana

"Don’t be scared of frustrating engineers; great design ops will measure impact and build bridges with other teams."

Frances Yllana Kaaren Hanson Husani Oakley Dan Olsen

DesignOps Exposed: What do our peers really think of us?

September 11, 2025

Jennifer Strickland

"Provocative prototypes provoke conversation and surface unspoken values."

Jennifer Strickland

Adopting a "Design By" Method

December 9, 2021

Dan Saffer

"AI struggles with context, taste, and common sense, and designers bring that to the table."

Dan Saffer

Why AI projects fail (and what we can do about it)

May 14, 2025

Eduardo Ortiz

"Researchers are becoming stewards of organizational wisdom, not just collectors of insight."

Eduardo Ortiz

Theme 3 Intro

March 13, 2025

Peter Merholz

"We can’t just rely on managers to do everything for career growth because managers change too often."

Peter Merholz

The Mysterious Case of the Missing UX Career Path

August 25, 2022