Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Laura Weiss
There is No Playbook: Leader as Coach During Challenging Times
2024 • Rosenfeld Community
Cennydd Bowles
Responsible Design in Reality
2021 • Design at Scale 2021
Gold
Charles Lee
Building a New Home for the Atlassian Design System
2020 • Enterprise Community
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Etienne Fang
Power of Insights: Why sharing is better than silos with Uber’s Insights Platform
2019 • Advancing Research Community
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Gold
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps Summit 2024
Gold
Greg Petroff
Everything is About to Change: Software as Material
2016 • Enterprise UX 2016
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How
2021 • Advancing Research Community
Tristin Oldani
Turning awareness into action with Climate UX
2025 • Climate UX Interest Group
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
Louis Rosenfeld
Do you want to work on climate? (Climate UX Discussion Series)
2023 • Climate UX Interest Group
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Ariel Kennan
Civic Design in 2022
2022 • Civic Design Community
Prayag Narula
Empowering Designers to do Good Research
2022 • Advancing Research 2022
Gold
Hugh Dubberly
Problems with Problems: Reconsidering the Frame of Designing as Problem-Solving
2019 • Enterprise Community

More Videos

Christian Rohrer

"Never put numbers on qualitative research findings; qualitative insights are about richness and why, not how many."

Christian Rohrer

Research Operations at Scale

November 7, 2017

Robert Schwartz

"This is us. This is all of us in this room. That could be your mom or your son or your daughter or you that have been through that."

Robert Schwartz

We're Here for the Humans

June 9, 2017

Kevin M. Hoffman

"Engineers are great at executing code but often lack connection to user experience and design processes."

Kevin M. Hoffman

Theme 2: Enterprise Team Journey

June 3, 2019

Gillian Salerno-Rebic

"The AI assistant enables ongoing conversation and follow-up questions to refine persona insights dynamically."

Gillian Salerno-Rebic Mark Micheli

From Insight to Impact: How JourneySpark Used WEVO Pulse + Pro to Drive a 50% Lift in Ad Engagement

June 11, 2025

Chris Hodowanec

"A smaller agile team may require less documentation but has less scope and velocity impact."

Chris Hodowanec

Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner

November 16, 2022

Indra Klavins

"The volume coming at me every day was like a week’s worth of work compressed into one day."

Indra Klavins

A Design Ops Girl in a Dev Ops World

October 23, 2019

Jose Coronado

"Design is the process of moving from an existing condition to a preferred condition—a form of problem solving."

Jose Coronado Julie Gitlin Lawrence Lipkin

People First - Design at JP Morgan

June 10, 2021

Ron Bronson

"Every problem is a research problem."

Ron Bronson

Design, Consequences & Everyday Life

November 18, 2022

Llewyn Paine

"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."

Llewyn Paine

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

March 11, 2025