Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
What co-speech gestures reveal about users’ thinking during interviews
Summary
Key Insights
-
•
Gestures provide a non-verbal window into users' mental models, often revealing thoughts not expressed in speech.
-
•
Representational gestures, especially those made in personal gesture space, indicate cognitive processes and implicit imagery.
-
•
Users commonly hold multiple, context-dependent mental models rather than a single static one.
-
•
In interviews, interviewer gestures increase participant gesturing and improve conversational rapport.
-
•
Video interviews pose challenges for capturing gestures fully; positioning and prompting can mitigate this.
-
•
Speech-gesture mismatches often signal ongoing mental model construction or word searching by users.
-
•
Gestures can reveal emotional attachment or disengagement with technology, influencing adoption and retention.
-
•
Mental models can be anchored by recent technology prototypes, such as chat GPT for AI understanding.
-
•
Structured interview protocols that elicit gesturing and separate talking from tool use optimize gesture data collection.
-
•
Open source motion tracking and gesture analysis tools can aid qualitative research by quantifying gesture patterns.
Notable Quotes
"Gestures are a window to the mind."
"Gesture and speech form an integrated system; they reinforce one another."
"We’re really leaving half of our data on the table by not attending to gesture when eliciting mental models."
"Gesture is not computer and smartphone gestures, but spontaneous movements people make with hands and arms."
"Four me gestures happen in that personal gesture space and serve as thinking tools for the speaker."
"When gestures and speech mismatch, it often means the speaker is still refining their mental model."
"Without looking at the gesture, we would have come to a less complete mental model."
"Users have more than one mental model; they can be constructed on the fly depending on context."
"The degree to which the user feels in control with an intelligent agent brings up conversational mental models."
"The more you gesture, the more your interviewee will gesture."
Or choose a question:
More Videos
"Solving one task in the design process can generate issues or benefits in different teams."
Patrizia Bertini Alexandra Mengoni LeónPushing DesignOps’ Influence into New Global Markets
September 9, 2022
"I liken that to a play: there’s acts, a cast of characters, and this inter-character drama."
Shazia Ali Bruce Gillespie Joyce Lee Andy WarrCommunication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
August 21, 2024
"Carbon is just the starting point for what can be imagined. We're hired for our expertise to adapt, not just follow directions."
Mitchell BernsteinOrganizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
September 29, 2021
"Mural’s facilitation superpowers allow you to conduct workshops with 30 people divided into groups seamlessly."
Erika FlowersIntroduction to MURAL for UX
June 11, 2021
"Before sharing insights, I try to prime the room by acknowledging feelings and starting fresh."
Jerome “Axle” BrownHow to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon
March 11, 2021
"You have to create a safe space for people to make mistakes in practicing UX research, because confidence grows over time."
Hana NagelTurning Research Ripples into Waves
November 8, 2018
"Algorithms help us find what we want quickly, but when used in criminal sentencing or healthcare, they can produce unfair and biased results."
Mandy DrewWhat Role(s) Can Research Play in Responsible Design?
March 11, 2021
"Why am I talking? Sometimes it’s better to ask a question and be silent."
Laura WeissThere is No Playbook: Leader as Coach During Challenging Times
April 26, 2024
"Design sprint 76 just kicked off yesterday, and the calendar lives on to align as best we can with software engineering."
Carla Casariego Sarah SpencerDesignOps in Wonderland
October 24, 2019
