Summary
In this talk, Steve recounts a difficult user research project for a fintech client focused on small business owners. He faced challenges recruiting participants due to opaque internal communication, unreachable colleagues, and a tight market of participants. After resorting to an unfamiliar recruiting agency, Steve encountered a participant suspicious and uncomfortable about the research intentions and the presence of two interviewers in a cramped space. The participant’s concerns about the interview’s purpose and incentive payments led to tense interactions, though ultimately he connected with Steve on LinkedIn. Reflecting on this, Steve introduces the concept of research war stories—personal narratives of struggles and failures in the field shared by researchers like Susan Simon Daniels, Randy Duke II, and Tamara Hale. Drawing from insights by George Dawes Green and Priya Parker, Steve emphasizes the importance of vulnerability, empathy, and storytelling to normalize failure and improve research practice. He encourages researchers to openly share their experiences to foster a supportive community where learning from mistakes is embraced as part of the craft. The talk closes with an invitation to contribute to an ongoing blog and the announcement of upcoming stories from other researchers.
Key Insights
-
•
Recruitment for user research can be hindered by internal communication breakdowns and limited participant pools.
-
•
Miscommunications between recruiters, participants, and researchers increase participant discomfort and complicate interviews.
-
•
Even polite participant pushback can feel confrontational during an emotionally charged interview.
-
•
Researchers often overcompensate with people-pleasing behaviors when rapport feels uncertain, which is counterproductive.
-
•
War stories capture the vulnerability and humanity inherent in research failures and challenges.
-
•
Sharing stories of failure helps researchers gain empathy for themselves and others, reducing harsh self-judgment.
-
•
Failure is inevitable in qualitative research and can provide crucial learning and personal growth opportunities.
-
•
Understanding research as a human endeavor involves managing unpredictability, emotion, and complex social dynamics.
-
•
Storytelling fosters community among researchers by normalizing failures and providing permission to be imperfect.
-
•
The value of research lies not only in findings but also in how experiences shape researchers permanently.
Notable Quotes
"It felt aggressive and angry and I spent the remainder of the interview feeling uncertain about our rapport."
"It’d be nice if we had someone to blame, but none of these are true."
"You probably have messed up. You probably will mess up. It’s inevitable and it’s okay."
"A story is about a decision that you made. It’s not about what happens to you."
"When you touch this vulnerability, people feel this ira comfort. I went through that myself."
"We tend to characterize our own experience in new or unexpected situations as messing up."
"Empathy is how you can more safely acknowledge that failure comes for us all."
"These war stories give you permission slips for your inevitable failures to come."
"The people doing the research are human, and the people we want to learn from are human."
"Sharing stories of failure normalizes thoughtful and transparent consideration of the work that we do."
Or choose a question:
More Videos
"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."
Sam ProulxSUS: A System Unusable for Twenty Percent of the Population
December 9, 2021
"It's kind of Peace Corps for nerds – people come in for a tour and try to have impact at scale."
Michael LandEstablishing Design Operations in Government
February 18, 2021
"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"People care about titles way too much. I had a guy whose business card said star-bellied sneak—love that."
Ian SwinsonDesigning and Driving UX Careers
June 8, 2016
"The chief of staff can be a natural next step from a design program manager or design ops leader of one."
Isaac HeyveldExpand DesignOps Leadership as a Chief of Staff
September 8, 2022
"Starting with one line of business and showing success creates a trickle effect for broader organizational adoption."
Amy EvansHow to Create Change
September 25, 2024
"Super intelligence is the power to gather and share knowledge consistently to ensure no gaps in communication."
Kate Koch Prateek KalliFlex Your Super Powers: When a Design Ops Team Scales to Power CX
September 30, 2021
"Most enterprises are not emotionally safe places; people can’t just leave emotions at the door."
Dave GrayLiminal Thinking: Sense-making for systems in large organizations
May 14, 2015
"Curation is super important, but also super hard."
Matt DuignanAtomizing Research: Trend or Trap
March 30, 2020
