Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Catherine Dubut
Bridging Physical and Digital Spaces: Approaches to Retail Service Design
2021 • Enterprise Community
Billy Carlson
Principles of Team Wireframing
2023 • DesignOps Summit 2023
Gold
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Emily Williams
When UX Research and Institutional Racism Collide: A Case Study
2021 • Advancing Research 2021
Gold
Josh Clark
Sentient Scenes and Radically Adaptive Experiences
2025 • Designing with AI 2025
Conference
Fredrik Matheson
First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.
2016 • Enterprise UX 2016
Gold
Shazia Ali
Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Melinda Belcher
Insider preview of Enterprise Experience 2020
2020 • Enterprise Community
Discussion
2017 • Enterprise Experience 2017
Gold
Prerna Makanawala
Achieving Balanced Design Consistency
2021 • Design at Scale 2021
Gold
Iram Shah
Closing Keynote: The View from the Top
2019 • Enterprise Experience 2019
Gold
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Trisha Causley
[Demo] Complexity in disguise: Crafting experiences for generative AI features
2024 • Designing with AI 2024
Gold
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community

More Videos

"We are like three legs of a chair: product, engineer, and UX all contribute to stability."

Product and Design at Bloomberg: A 15-year Evolution

December 6, 2022

Dr. Jamika D. Burge

"The storytelling is what ultimately supports actual change more than just data."

Dr. Jamika D. Burge Jemma Ahmed Chris Geison

Bridge Building across Research Disciplines

August 26, 2021

John Taschek

"I don’t know what I do day to day to make anything happen, and maybe that means I have to do less."

John Taschek

Making People the X-Factor in the Enterprise

June 15, 2018

Ana Ferreira

"We evaluate the work and not the amount of hours."

Ana Ferreira

Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries

January 8, 2024

Louis Rosenfeld

"Please don’t implement the Spotify model. It works for them, it won’t work for you."

Louis Rosenfeld

Discussion: What Operations can teach DesignOps

November 6, 2017

Jilanna Wilson

"Cameras on in Zoom meetings is a small act with a powerful impact against isolation."

Jilanna Wilson

Distributed DesignOps Management

February 26, 2019

Sam Ladner

"One in four American workers actively distrust their employers, believing they lie regularly."

Sam Ladner

Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX

June 8, 2016

Ricardo Martins

"Conjoint analysis was used by Apple and Samsung to determine the financial value of specific product features."

Ricardo Martins

Unlocking the power of advanced quantitative methods

March 12, 2025

Jen Cardello

"If we think about accelerating learning velocity, it's about creating specific altitudes of research questions to answer for the organization."

Jen Cardello Dr. Shadi Janansefat Alex Wright

Curating insight: Strategies for integrating knowledge across research functions

March 11, 2025