Summary
The speaker shares his journey from a computer science background to becoming a cognitive science PhD and UX expert working at notable companies like Yahoo, eBay, Realtor, and Intel Security. He uses this experience to frame how to gather user insights, particularly in enterprise UX where users range from end users to administrators and buyers with differing needs. He introduces a layered model of user experience focusing on core user needs, usability, and appeal. Then, he presents a 3D research methods framework spanning qualitative to quantitative, behavioral to attitudinal data, and context of use from natural to scripted. Usability studies, ethnographic fieldwork, surveys, big data, and concept testing each fit differently on this landscape and serve particular phases of product development: strategize (focus on user needs with field studies and interviews), optimize (diagnosing usability issues), and assess (measuring success quantitatively). Challenges in enterprise UX include multiple user personas, conflicting priorities, and access constraints. The speaker highlights pitfalls such as relying on anecdotal data or conflating buyer insights with user needs. Finally, he recommends a balanced approach combining quantitative behavioral and attitudinal methods with qualitative field studies to form a "golden trapezoid" of user research for better decision making.
Key Insights
-
•
Enterprise UX must consider distinct roles: end users, administrators, and buyers, each with unique needs.
-
•
A layered user experience model centers on core user needs, surrounded by usability and then content/look and feel.
-
•
Qualitative research is direct and rich in context, enabling discovery of unexpected insights.
-
•
Quantitative research is mostly indirect and excels at measuring how much or how many, providing certainty.
-
•
Behavioral data shows what users do, attitudinal data reflects what users say, and both must be considered.
-
•
Context of use matters: natural, scripted, decontextualized, and hybrid methods reveal different facets of user experience.
-
•
Ethnographic field studies are the most powerful qualitative method for understanding real-world user behavior.
-
•
Enterprise UX faces access issues, competing priorities, and internal politics that impact research and product decisions.
-
•
Product development stages map to research needs: strategize phase focuses on user needs, optimize on usability, assess on outcomes.
-
•
Combining quantitative behavioral/attitudinal methods with qualitative field studies forms a balanced, effective insight generation approach.
Notable Quotes
"Every great user experience begins with meeting a user need at its very core."
"Security and great user experience is almost a null set — we need to enlarge that circle."
"What people say and what people do are not the same thing, not because they lie but often because they aren’t aware."
"In enterprise, people often just want to not get fired — that’s a very important need."
"Having no competition can be a problem because there’s no pressure to create a great user experience."
"Field studies are the most powerful qualitative method available — nothing else compares for real-world insight."
"Most executives think user research is big numbers good, small numbers bad, or focus groups with M&Ms."
"What we often see in enterprises is anecdotal or self-reported data that doesn’t reflect the true user ecosystem."
"Usability labs are qualitative and mostly behavioral, and they help diagnose why something isn’t working."
"The golden trapezoid of user research combines quantitative behavioral and attitudinal data with field studies for best insights."
Dig deeper—ask the Rosenbot:
More Videos
"Research is about being ready for anything, even what you didn’t imagine."
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020
"Layoffs are a collective trauma – it’s okay to acknowledge the emotions and grief you feel."
Corey Nelson Amy SanteeLayoffs
November 15, 2022
"If you measure an infinite number of customers, every change would be statistically significant, but not every change would be meaningful."
Landon BarnesAre My Research Findings Actually Meaningful?
March 10, 2022
"Design for Evil by Chris Nodder is a great resource to understand how behavioral design can be misused, sometimes very subtly."
Amy BucherHarnessing behavioral science to uncover deeper truths
March 12, 2025
"Momentum in users is like energy in fluid—strong motivation drives fast, decisive movement."
David SternbergUncovering the hidden forces shaping user behavior
July 17, 2025
"Processes are never perfect, but thoughtful testing limits disruption for your team."
Deanna SmithLeading Change with Confidence: Strategies for Optimizing Your Process
September 23, 2024
"Work on yourself. Understand your identity and privilege before trying to serve others."
Jennifer StricklandAdopting a "Design By" Method
December 9, 2021
"Around 14 to 20 designers is usually the tipping point where having a dedicated design ops person starts to make sense."
Rachel Posman John CalhounA Closer Look at Team Ops and Product Ops (Two Sides of the DesignOps Coin)
November 19, 2020
"Provoking and reframing perspective helps teams get unstuck by thinking in new and surprising ways."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
