Summary
The speaker shares his journey from a computer science background to becoming a cognitive science PhD and UX expert working at notable companies like Yahoo, eBay, Realtor, and Intel Security. He uses this experience to frame how to gather user insights, particularly in enterprise UX where users range from end users to administrators and buyers with differing needs. He introduces a layered model of user experience focusing on core user needs, usability, and appeal. Then, he presents a 3D research methods framework spanning qualitative to quantitative, behavioral to attitudinal data, and context of use from natural to scripted. Usability studies, ethnographic fieldwork, surveys, big data, and concept testing each fit differently on this landscape and serve particular phases of product development: strategize (focus on user needs with field studies and interviews), optimize (diagnosing usability issues), and assess (measuring success quantitatively). Challenges in enterprise UX include multiple user personas, conflicting priorities, and access constraints. The speaker highlights pitfalls such as relying on anecdotal data or conflating buyer insights with user needs. Finally, he recommends a balanced approach combining quantitative behavioral and attitudinal methods with qualitative field studies to form a "golden trapezoid" of user research for better decision making.
Key Insights
-
•
Enterprise UX must consider distinct roles: end users, administrators, and buyers, each with unique needs.
-
•
A layered user experience model centers on core user needs, surrounded by usability and then content/look and feel.
-
•
Qualitative research is direct and rich in context, enabling discovery of unexpected insights.
-
•
Quantitative research is mostly indirect and excels at measuring how much or how many, providing certainty.
-
•
Behavioral data shows what users do, attitudinal data reflects what users say, and both must be considered.
-
•
Context of use matters: natural, scripted, decontextualized, and hybrid methods reveal different facets of user experience.
-
•
Ethnographic field studies are the most powerful qualitative method for understanding real-world user behavior.
-
•
Enterprise UX faces access issues, competing priorities, and internal politics that impact research and product decisions.
-
•
Product development stages map to research needs: strategize phase focuses on user needs, optimize on usability, assess on outcomes.
-
•
Combining quantitative behavioral/attitudinal methods with qualitative field studies forms a balanced, effective insight generation approach.
Notable Quotes
"Every great user experience begins with meeting a user need at its very core."
"Security and great user experience is almost a null set — we need to enlarge that circle."
"What people say and what people do are not the same thing, not because they lie but often because they aren’t aware."
"In enterprise, people often just want to not get fired — that’s a very important need."
"Having no competition can be a problem because there’s no pressure to create a great user experience."
"Field studies are the most powerful qualitative method available — nothing else compares for real-world insight."
"Most executives think user research is big numbers good, small numbers bad, or focus groups with M&Ms."
"What we often see in enterprises is anecdotal or self-reported data that doesn’t reflect the true user ecosystem."
"Usability labs are qualitative and mostly behavioral, and they help diagnose why something isn’t working."
"The golden trapezoid of user research combines quantitative behavioral and attitudinal data with field studies for best insights."
Or choose a question:
More Videos
"Diversity is beyond just the right thing to do. Our teams must reflect the world we’re designing for."
Doug PowellClosing Keynote: Design at Scale
November 8, 2018
"Power dynamics exist in every session. People don’t want to be embarrassed or feel put on the spot."
Mila Kuznetsova Lucy DentonHow Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
March 9, 2022
"In Toronto it’s now illegal to transmit a Wi-Fi signal in designated public spaces, with penalties for violations—a policy driven by people wanting to unplug from digital life."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"Stakeholders start demanding better digital experiences at work because they expect the same quality they have at home."
Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne RogondinoTheme 1: Discussion
January 8, 2024
"AI is here to stay, challenging our norms and shaping our future."
Alnie FigueroaThe Future of Design Operations: Transforming Our Craft
September 10, 2025
"When executives start questioning your research details, that’s a good sign they’re engaged and trusting the process."
Landon BarnesAre My Research Findings Actually Meaningful?
March 10, 2022
"It’s the worst thing when someone feels dumb in front of a customer because the tools don’t support them."
Emily EagleCan't Rewind: Radio and Retail
June 3, 2019
"The curse of hyper-focus means you lose peripheral vision and miss the larger context and customer needs."
Malini RaoLessons Learned from a 4-year Product Re-platforming Journey
June 9, 2021
"Designers are often seen as bottlenecks because our work is harder to estimate and track than engineering’s."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023
