Summary
The speaker shares his journey from a computer science background to becoming a cognitive science PhD and UX expert working at notable companies like Yahoo, eBay, Realtor, and Intel Security. He uses this experience to frame how to gather user insights, particularly in enterprise UX where users range from end users to administrators and buyers with differing needs. He introduces a layered model of user experience focusing on core user needs, usability, and appeal. Then, he presents a 3D research methods framework spanning qualitative to quantitative, behavioral to attitudinal data, and context of use from natural to scripted. Usability studies, ethnographic fieldwork, surveys, big data, and concept testing each fit differently on this landscape and serve particular phases of product development: strategize (focus on user needs with field studies and interviews), optimize (diagnosing usability issues), and assess (measuring success quantitatively). Challenges in enterprise UX include multiple user personas, conflicting priorities, and access constraints. The speaker highlights pitfalls such as relying on anecdotal data or conflating buyer insights with user needs. Finally, he recommends a balanced approach combining quantitative behavioral and attitudinal methods with qualitative field studies to form a "golden trapezoid" of user research for better decision making.
Key Insights
-
•
Enterprise UX must consider distinct roles: end users, administrators, and buyers, each with unique needs.
-
•
A layered user experience model centers on core user needs, surrounded by usability and then content/look and feel.
-
•
Qualitative research is direct and rich in context, enabling discovery of unexpected insights.
-
•
Quantitative research is mostly indirect and excels at measuring how much or how many, providing certainty.
-
•
Behavioral data shows what users do, attitudinal data reflects what users say, and both must be considered.
-
•
Context of use matters: natural, scripted, decontextualized, and hybrid methods reveal different facets of user experience.
-
•
Ethnographic field studies are the most powerful qualitative method for understanding real-world user behavior.
-
•
Enterprise UX faces access issues, competing priorities, and internal politics that impact research and product decisions.
-
•
Product development stages map to research needs: strategize phase focuses on user needs, optimize on usability, assess on outcomes.
-
•
Combining quantitative behavioral/attitudinal methods with qualitative field studies forms a balanced, effective insight generation approach.
Notable Quotes
"Every great user experience begins with meeting a user need at its very core."
"Security and great user experience is almost a null set — we need to enlarge that circle."
"What people say and what people do are not the same thing, not because they lie but often because they aren’t aware."
"In enterprise, people often just want to not get fired — that’s a very important need."
"Having no competition can be a problem because there’s no pressure to create a great user experience."
"Field studies are the most powerful qualitative method available — nothing else compares for real-world insight."
"Most executives think user research is big numbers good, small numbers bad, or focus groups with M&Ms."
"What we often see in enterprises is anecdotal or self-reported data that doesn’t reflect the true user ecosystem."
"Usability labs are qualitative and mostly behavioral, and they help diagnose why something isn’t working."
"The golden trapezoid of user research combines quantitative behavioral and attitudinal data with field studies for best insights."
Or choose a question:
More Videos
"The epidemic of isolation is tied to digital design that creates connectivity without connection."
Daniel GloydDesigning Warmth
February 26, 2025
"Pilot projects with evangelists inside the company make ethnography manageable and successful."
Steve Portigal Chris Chapo Kelly Goto Christian RohrerDiscussion
May 13, 2015
"If your priorities are roughly aligned with organizational priorities, you’ll be making good trade-offs."
Harry Max Jim MeyerPrioritization for Leaders (2nd of 3 seminars)
June 27, 2024
"Conflicts caused by layers moving at different speeds actually keep things balanced and resilient."
Brigette MetzlerScaling ResearchOps: Helping Researchers do Their Best Work
March 30, 2020
"All the brands that came to us to understand women were really trying to understand us."
Jennifer KanyamibwaCreating the Blueprint: Growing and Building Design Teams
November 8, 2018
"Pre-work allows people to share who they are and their interests, building trust before the session."
Emilia Åström Jim KalbachUnlock Your Team’s Intelligence with Collaboration Design
June 9, 2022
"Usability labs are qualitative and mostly behavioral, and they help diagnose why something isn’t working."
Christian RohrerInsight Types That Influence Enterprise Decision Makers
May 13, 2015
"Moving research upstream in the product process helps solve problems faster and save millions of dollars."
George Zhang Molly StevensUX Research Excellence Framework
March 11, 2021
"All session notes and resources will be available within the hour, so you can just relax and absorb the content."
Bria AlexanderOpening Remarks
September 30, 2021
