Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • The body shapes the mind and thinking through continuous interaction with the world and social environment.

  • Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.

  • Embodied actions tend to be intentional, goal-directed interactions with the physical environment.

  • Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.

  • Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.

  • AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.

  • In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.

  • Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.

  • Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.

  • The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."

"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."

"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."

"For some users, AI products are not just tools, they are relationships."

"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."

"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."

"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."

"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."

"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."

Ask the Rosenbot
Chris Geison
Theme 1 Intro
2022 • Advancing Research 2022
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Prayag Narula
How to Empower Your Designers to Do Good Research – And Why You Want To
2022 • Design at Scale 2022
Gold
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Gonzalo Goyanes
Design ROI: Cover a Little, Get a Lot
2022 • DesignOps Summit 2022
Gold
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Dawn Ressel
Full-Stack User Experiences: A Marriage of Design and Technology
2016 • Enterprise UX 2016
Gold
PJ Buddhari
Meet Spectrum, Adobe’s Design System
2021 • Design at Scale 2021
Gold
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Abby Covert
Stuck? Diagrams Help
2022 • DesignOps Community
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
Jennifer Kong
Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
George Abraham
Design Systems To-Go: Introducing a Starter Design System, and Indigo.Design Overview (Part 1)
2021 • DesignOps Summit 2021
Gold
Uday Gajendar
Theme Four Intro
2023 • Enterprise UX 2023
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold

More Videos

Emily Lessard

"No printing or shipping. Digital is just fine and much more sustainable."

Emily Lessard

RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent

December 9, 2021

Cennydd Bowles

"Technology does not have a mind of its own; people with power set its trajectory and we can influence that."

Cennydd Bowles Dan Rosenberg Lisa Welchman

Day 1 Panel

June 4, 2024

Bria Alexander

"If you have a question for a speaker, put it in the thread for their talk, not in the general chat."

Bria Alexander

Opening Remarks

November 18, 2022

Laura Gatewood

"Slack clips can add tone and body language that is too hard to capture in the written word."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Joanna Vodopivec

"Collaboration with another researcher was seamless because we speak the same methodology language and aligned on goals."

Joanna Vodopivec Prabhas Pokharel

One Research Team for All - Influence Without Authority

March 9, 2022

Lada Gorlenko

"Junior team members don’t have to talk directly to executives; working effectively with peers can create grassroots buy-in."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Aditi Ruiz

"It’s important not to seek control but understanding."

Aditi Ruiz Christian Crumlish Farid Sabitov

A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1

December 6, 2022

Ned Dwyer

"We were using 10 different tools to do bite-size pieces of the research flow internally."

Ned Dwyer Jadyn Aguilar

The Future of DesignOps is Tool Consolidation

September 23, 2024

Jake Burghardt

"Scaling up research impact means turning visibility way up and opening access despite some risk of misuse."

Jake Burghardt

Stop wasting research: Create new value with insight summaries

July 9, 2025