Summary
The speaker shares his journey from a computer science background to becoming a cognitive science PhD and UX expert working at notable companies like Yahoo, eBay, Realtor, and Intel Security. He uses this experience to frame how to gather user insights, particularly in enterprise UX where users range from end users to administrators and buyers with differing needs. He introduces a layered model of user experience focusing on core user needs, usability, and appeal. Then, he presents a 3D research methods framework spanning qualitative to quantitative, behavioral to attitudinal data, and context of use from natural to scripted. Usability studies, ethnographic fieldwork, surveys, big data, and concept testing each fit differently on this landscape and serve particular phases of product development: strategize (focus on user needs with field studies and interviews), optimize (diagnosing usability issues), and assess (measuring success quantitatively). Challenges in enterprise UX include multiple user personas, conflicting priorities, and access constraints. The speaker highlights pitfalls such as relying on anecdotal data or conflating buyer insights with user needs. Finally, he recommends a balanced approach combining quantitative behavioral and attitudinal methods with qualitative field studies to form a "golden trapezoid" of user research for better decision making.
Key Insights
-
•
Enterprise UX must consider distinct roles: end users, administrators, and buyers, each with unique needs.
-
•
A layered user experience model centers on core user needs, surrounded by usability and then content/look and feel.
-
•
Qualitative research is direct and rich in context, enabling discovery of unexpected insights.
-
•
Quantitative research is mostly indirect and excels at measuring how much or how many, providing certainty.
-
•
Behavioral data shows what users do, attitudinal data reflects what users say, and both must be considered.
-
•
Context of use matters: natural, scripted, decontextualized, and hybrid methods reveal different facets of user experience.
-
•
Ethnographic field studies are the most powerful qualitative method for understanding real-world user behavior.
-
•
Enterprise UX faces access issues, competing priorities, and internal politics that impact research and product decisions.
-
•
Product development stages map to research needs: strategize phase focuses on user needs, optimize on usability, assess on outcomes.
-
•
Combining quantitative behavioral/attitudinal methods with qualitative field studies forms a balanced, effective insight generation approach.
Notable Quotes
"Every great user experience begins with meeting a user need at its very core."
"Security and great user experience is almost a null set — we need to enlarge that circle."
"What people say and what people do are not the same thing, not because they lie but often because they aren’t aware."
"In enterprise, people often just want to not get fired — that’s a very important need."
"Having no competition can be a problem because there’s no pressure to create a great user experience."
"Field studies are the most powerful qualitative method available — nothing else compares for real-world insight."
"Most executives think user research is big numbers good, small numbers bad, or focus groups with M&Ms."
"What we often see in enterprises is anecdotal or self-reported data that doesn’t reflect the true user ecosystem."
"Usability labs are qualitative and mostly behavioral, and they help diagnose why something isn’t working."
"The golden trapezoid of user research combines quantitative behavioral and attitudinal data with field studies for best insights."
Or choose a question:
More Videos
"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."
Sam ProulxSUS: A System Unusable for Twenty Percent of the Population
December 9, 2021
"It's kind of Peace Corps for nerds – people come in for a tour and try to have impact at scale."
Michael LandEstablishing Design Operations in Government
February 18, 2021
"I spent too much time trying to change company culture and should have focused more on just getting things done."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"A workshop helps people map their skills, identify gaps, and make specific goals for career jumps."
Ian SwinsonDesigning and Driving UX Careers
June 8, 2016
"If you’re managing over 100 design practitioners, it makes sense to start looking at a chief of staff role."
Isaac HeyveldExpand DesignOps Leadership as a Chief of Staff
September 8, 2022
"Design takes on a new role as governance practitioner, overseeing branding, content, and accessibility."
Amy EvansHow to Create Change
September 25, 2024
"Super strength is the resilience and endurance to partner and drive strategic impact backed by customer obsession."
Kate Koch Prateek KalliFlex Your Super Powers: When a Design Ops Team Scales to Power CX
September 30, 2021
"Most enterprises are not emotionally safe places; people can’t just leave emotions at the door."
Dave GrayLiminal Thinking: Sense-making for systems in large organizations
May 14, 2015
"Product teams want quick, grab-and-go research results, but reusable insights are more abstract and take longer to digest."
Matt DuignanAtomizing Research: Trend or Trap
March 30, 2020
