Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Ask the Rosenbot
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Elizabeth Sklar
Co-creating research enablement with your tech org: a case study
2026 • Advancing Research 2026
Conference
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Christian Crumlish
The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…
2025 • Rosenfeld Community
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Iain McMaster
Design and Product: from Frenemy to Harmony
2023 • Design in Product 2023
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • Civic Design 2021
Gold
Jacqui Frey
Setting the Table for Dynamic Change
2019 • DesignOps Summit 2019
Gold
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Conference
Jerome “Axle” Brown
How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon
2021 • Advancing Research 2021
Gold
Andy Warr
Under My (Research) Umbrella: The Benefits and Challenges of Building a Unified Insights Function
2024 • Advancing Research 2024
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Nathan Reiff
Research, from Unimaginable to Presently Possible: A Future-Casting Sticky-Note Sprint
2026 • Advancing Research 2026
Conference
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold

More Videos

Patrick Commarford

"We automated everything — now we click a button weekly to produce updated staffing and priority alignment scores."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Sarah Fathallah

"It's unwise for us to intervene when we're not equipped to close the doors that would be opened in doing so."

Sarah Fathallah

Lessening the Research Burden on Vulnerable Communities

March 30, 2020

Jacqui Frey

"You will have zero successes if you’re not trying it all."

Jacqui Frey Alison Rand

Setting the Table for Dynamic Change

October 24, 2019

John Calhoun

"Hold your destination in mind. Have an intention to succeed. Break up the long tracks and brace for the hard parts."

John Calhoun

Have we Reached Our Peak? Spotting the Next Mountain For DesignOps to Climb

October 1, 2021

Jake Burghardt

"Too often research lives in silos, making it hard to connect the dots across streams."

Jake Burghardt

Stop wasting research: Unlock more value from research insights

June 24, 2025

Adel Du Toit

"This is not just a typical HR survey; it focuses deeply on the products and experiences employees use daily."

Adel Du Toit

Get Your CFO To Say: 'Our Strategic Goal is User Obsession'

June 10, 2022

Candace Myers

"The automatic soap dispenser was designed based on a bias by standard and distributed widely with the bystandard."

Candace Myers

Standardizing Design at Scale

September 9, 2022

Dalia El-Shimy

"Closing the loop by understanding when and why recommendations don’t get adopted is probably the most easily actionable piece of advice I can give."

Dalia El-Shimy

So You've Got a Seat at the Table. Now What?

March 31, 2020

Erika Flowers

"Most presentations at Mural happen inside Mural itself — slides are becoming a thing of the past."

Erika Flowers

Introduction to MURAL for UX

June 11, 2021