Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Summary
At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.
Key Insights
-
•
Effective UX metrics balance qualitative surveys and quantitative user behavior data.
-
•
Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.
-
•
Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.
-
•
UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.
-
•
Embedding metrics collection proactively in agile workflows improves product evaluation.
-
•
UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.
-
•
There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.
-
•
Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.
-
•
Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.
-
•
Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.
Notable Quotes
"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."
"You don't know if you're successful until your users are successful in accomplishing their goals using your product."
"Too many teams think delivering software means success, but actual success is user achievement with the product."
"Triangulation is key — compare multiple metrics to understand why scores move the way they do."
"Proactive measurement before release combined with post-release evaluation is the ideal approach."
"We often need to evangelize the importance of collecting UX metrics to teams and leadership."
"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."
"Design influence is messy and requires clear articulation of how we serve business and customer success."
"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."
"Culture needs to accept failure as part of learning so we can improve rather than assign blame."
Or choose a question:
More Videos
"Using the umbrella term 'people of color' erases the most disadvantaged and privileges the least burdened."
Alba VillamilStereotyped by Design: Pitfalls in Cross-Cultural User Research
March 30, 2020
"We love small teams because we move fast and break things and figure things out on the fly."
Jacqui Frey Dan WillisPanel Discussion: Integrating DesignOps
November 7, 2018
"We created Tiger teams that work like cancer cell hunters, targeting isolated problems and then dissolving after their work is done."
Maria GiudiceRemaking the Making Company: Moving from Product to Experience
June 9, 2016
"Start every project by asking What about women?"
Mansi GuptaWomen-Centric Research: What, Why, How
March 29, 2023
"Use plain language in all communication. No design or technology jargon."
Marisa BernsteinIt Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
December 9, 2021
"Inconsistency stokes cynicism; consistency helps bolster our faith in the world."
Margot BloomsteinFostering Trust in Your Brand and Beyond
March 12, 2020
"Compensation should be culturally competent and consider all supports participants might need to show up fully."
Matt Bernius Rachael Dietkus, LCSW Aditi Joshi Alba VillamilLearnings from Applying Trauma-Informed Principles to the Research Process
March 10, 2022
"The Rosen Bot is narrow in scope, just UX and product design content that's super high quality."
Louis RosenfeldGenAI for UXers: A Rosenbot Demo and Discussion
June 11, 2025
"Personalization at scale is made possible by capturing activity data and correlating it across millions of residents."
Angy Peterson Bob AinsburyMore Than Technology: Personalized Public Sector Experiences
December 10, 2021