Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not

Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Ask the Rosenbot
Brigette Metzler
Scaling ResearchOps: Helping Researchers do Their Best Work
2020 • Advancing Research 2020
Gold
Alastair Simpson
Debunking the Myths of Cross-Disciplinary Collaboration
2019 • DesignOps Summit 2019
Gold
Sarah Auslander
Insights Panel
2022 • Civic Design 2022
Gold
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Dr. Jamika D. Burge
Bridge Building across Research Disciplines
2021 • Advancing Research Community
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Dave Hora
Advice for Establishing Research
2022 • Advancing Research Community
Joshua Graves
We Need To Talk: Managing Ludicrous Requests at Work (Part 3 of 3)
2025 • Rosenfeld Community
George Abraham
Design Systems To-Go: Indigo.Design Overview and Exploring the Developer Workflow (Part 3)
2021 • DesignOps Summit 2021
Gold
Weidan Li
Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Sarah Brooks
Theme Three Intro
2022 • Civic Design 2022
Gold
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Jemma Ahmed
Convergent Research Techniques in Customer Journey Mapping
2020 • Advancing Research 2020
Gold

More Videos

Brad Peters

"When it comes to the data we’re providing, that decision point is really important for PMs."

Brad Peters Anne Mamaghani

Short Take #1: UX/Product Lessons from Your Industry Peers

December 6, 2022

Frances Yllana

"Office housework is everything from administrative tasks to employee engagement; it’s undervalued but essential for team success."

Frances Yllana

DesignOps–Leading the Path to Parity

April 27, 2023

Liwei Dai

"To be truly impactful, human researchers need to actively participate in product design sprints and strategy meetings."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Laureen Kattan

"Prioritizing across a complex ecosystem of business owners requires deep alignment between product and UX or the product never moves forward."

Laureen Kattan Julie Kim

Centering Patients and Clinicians in a Complex Government Ecosystem

November 29, 2023

James Wieselman Schulman

"We are asked to produce more and more work with fewer people and smaller teams."

James Wieselman Schulman

Research is a team sport: advancing the work when everyone does the research

March 11, 2026

"There’s opportunity to shift people internally within organizations rather than just hiring externally to fill experience design roles."

DesignOps and The Great Talent War of 2021

August 19, 2021

Saara Kamppari-Miller

"Fixing an accessibility bug in production is exponentially more expensive than if you catch it during design or planning."

Saara Kamppari-Miller

Theme Three Intro

October 4, 2023

Kristin Skinner

"Shared outcomes and shared goals are critical to any measurement initiative."

Kristin Skinner Kamdyn Moore

8 Types of Measures in Design Operations

April 16, 2020

Taylor Klassman

"In a remote environment, building authentic, deep relationships with stakeholders is a key skill for researchers."

Taylor Klassman

Shaping the Next Era of UX Research: Collaborative Forum

March 11, 2025