Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Ask the Rosenbot
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Maria Giudice
Empowering change: Reigniting purpose, passion and impact in research
2025 • Advancing Research 2025
Gold
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Jilanna Wilson
Distributed Design Operations Management
2019 • DesignOps Summit 2019
Gold
Chris Geison
What's Next for Research?
2021 • Advancing Research Community
Isaac Heyveld
Expand DesignOps Leadership as a Chief of Staff
2022 • DesignOps Summit 2022
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 1: The new product journey
2025 • Rosenfeld Community
John Cutler
Prioritization for designers and product managers (1st of 3 seminars)
2024 • Rosenfeld Community
Erin Weigel
Real-world lessons to improve your conversion rates
2024 • Rosenfeld Community
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Aras Bilgen
Research Democratization: A Debate
2023 • Advancing Research 2023
Gold
David Cronin
The GE Design System and Thoughts about Craft at Scale
2015 • Enterprise UX 2015
Gold
Irina Tikhonova
Small Wins, Big Impact: Leveraging and Elevating User Engagement
2021 • Civic Design 2021
Gold
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold

More Videos

Jim Kalbach

"People don’t want a quarter inch drill, they want a quarter inch hole."

Jim Kalbach

Jobs To Be Done

February 25, 2021

Mike Brzozowski

"UX writing and design are a wonderful symbiotic relationship; both are needed to help users understand and act."

Mike Brzozowski Laura Palotie Steve Isley Nancy Tsang

UX in everyday products: Empowering climate conscious choices

July 17, 2024

Smitha Papolu

"Find who the customer success leader is and get them embedded right in your scrum teams at the beginning, that's huge."

Smitha Papolu Nova Wehman-Brown Melissa Schmidt Adam Menter

Theme 3 Discussion

June 4, 2019

Aurobinda Pradhan

"Traditional devops tools are more task and issue-centric, but designers think in processes and workflows."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022

Caitlyn Hampton

"The agents are brutally honest with their feedback, which helps us prioritize features that actually matter to them."

Caitlyn Hampton Monica Lee Jina Yoon

Compass 101: Growing Your Career In A Startup World

June 11, 2021

Andrea Gallagher

"Data repositories often fail because of the complexity in cataloging and who can access the information."

Andrea Gallagher

The Problem Space

May 16, 2019

Jonathon Colman

"In the absence of clear message or strong value prop, people assumed Facebook was always listening to all their conversations."

Jonathon Colman

How to Maximize the Impact of Content Design

January 8, 2024

Laura Klein

"When things start to go bad, we’re going to pull the plug on it immediately—that helps build trust."

Laura Klein

Unique challenges of innovation in enterprises

April 23, 2020

Prayag Narula

"Feature bloat kills usability because it clouds the core value proposition."

Prayag Narula Hannah Hudson

Empowering Designers to do Good Research

March 11, 2022