Summary
A story about how to quantify and use survey data to create audience clusters that are statistically representative of the people that use your online product or service. Edgar joins the dots between multiple research/pattern finding/storytelling techniques, such as proto-personas, affinity mapping, survey creation, quantification of qualitative data, organic clustering of audiences, user interviews, journey maps, and business modeling canvas. It makes research tangible and actionable: instead of being an end-point that provides stakeholders with insights, it takes stakeholders through an inclusive and structured process they can be part of.
Key Insights
-
•
Research often fails when stakeholders are not involved or don't trust the data sources and methodologies.
-
•
Treating research as a product, with stakeholders as users, drastically increases engagement and usability.
-
•
Using proto-persona workshops with cross-department stakeholders helps generate unbiased, relevant survey questions.
-
•
Clustering survey data via Python and correlation matrices can reveal meaningful user segments with statistical significance.
-
•
Statistical validity (e.g., 95% confidence at 5% margin) is critical for stakeholder buy-in in large user bases.
-
•
Behavioral and demographic clusters need to be augmented with emotional attributes to create actionable personas.
-
•
Affinity mapping large qualitative datasets reduces noise and distills coherent narratives and pain points.
-
•
Mapping pain points to measurable hypotheses enables prioritization based on user impact and implementation effort.
-
•
Divergent and convergent workshops using tools like the business model canvas help explore and refine value proposition delivery.
-
•
Iterative, lean research with frequent stakeholder feedback helps identify and minimize bias effectively.
Notable Quotes
"Research should be done the same way products are built, with stakeholders as your users."
"If you frame the research in terms your stakeholders understand, they will become research-hungry."
"We don’t make big deliverables because they create friction; instead, we create shared understanding through conversations."
"Proto-persona sessions helped us avoid departmental bias and uncover the questions stakeholders really cared about."
"We used a 0.8 correlation threshold to tightly cluster similar survey responses, balancing cluster count and inclusion."
"Clusters alone aren’t personas; we turned clusters into interview screeners and then emotional personas."
"We wrote hypotheses as we believe this pain point matters, here’s how we test it, and how success looks."
"Different stakeholders tackle the delivery problem differently, which gave us necessary divergent thinking."
"Biases surface as you iterate, so lean approaches help you find and fix them quicker."
"Marital status mattered because some people buy cars for their spouses or kids, not just themselves."
Or choose a question:
More Videos
"Our teams focus on entire customer outcomes, not just features."
Scher Foord Corey Greenltch Sarah RoweTurn the Ship Around: How to Apply Design Thinking Across Your Organization
June 10, 2021
"The phenomenon of interest cannot be separated from the context in qualitative research because everything is interconnected."
Mohammad Hossein JarrahiContextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
January 20, 2023
"Qualitative researchers can help design better human-in-the-loop evaluation guidelines that consider social context."
Prayag Narula Rida QadriHCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
March 28, 2023
"Since we started this presentation, enough data has been collected to fill everyone’s hard drive about 500,000 times, and fewer than 1% is ever used for insights."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"You have to think critically about how a change impacts all stakeholders, not just the main business metric."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
"Climate change is not just an environmental issue; it's a public health crisis."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Collaborating with cross-functional peers is where the juice happens—it’s paramount to our success in design ops."
Dominique WardThe Most Exciting Time for DesignOps is Now
September 8, 2022
"You need a lot of annoying handholding with the AI: reminding it of how many people you have or simple things."
Yulya Besplemennova[Demo] Stress-testing GenAI in user research synthesis
June 4, 2024
"You’re never going to convince business people with product language, but you can with financial language they care about."
Giff ConstableFinancial fluency for product leaders: AMA with Giff Constable
April 11, 2024
