Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Summary
At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.
Key Insights
-
•
Effective UX metrics balance qualitative surveys and quantitative user behavior data.
-
•
Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.
-
•
Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.
-
•
UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.
-
•
Embedding metrics collection proactively in agile workflows improves product evaluation.
-
•
UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.
-
•
There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.
-
•
Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.
-
•
Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.
-
•
Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.
Notable Quotes
"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."
"You don't know if you're successful until your users are successful in accomplishing their goals using your product."
"Too many teams think delivering software means success, but actual success is user achievement with the product."
"Triangulation is key — compare multiple metrics to understand why scores move the way they do."
"Proactive measurement before release combined with post-release evaluation is the ideal approach."
"We often need to evangelize the importance of collecting UX metrics to teams and leadership."
"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."
"Design influence is messy and requires clear articulation of how we serve business and customer success."
"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."
"Culture needs to accept failure as part of learning so we can improve rather than assign blame."
Or choose a question:
More Videos
"There are allies everywhere, even in unexpected places inside your organization."
Leah Buley Joe NatoliAsk Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
October 8, 2024
"Clear outcomes and defined secure behaviors are better than vague goals like 'be more secure'."
Heidi TrostTo Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity
January 23, 2025
"Being aware of the systemic lens is a big first step that changes how teams operate and design."
Cornelius RachieruHandling Complexity: Framing a Scale of Design
June 9, 2021
"We had to update our taxonomy because 'computer' was too broad; we needed to capture monitors, laptops, and other devices separately."
Michele MarutResearch Repositories Reconsidered
February 14, 2019
"What does ‘best work’ mean? It’s different for everyone, so our solutions have to be flexible and meaningful."
Kim Fellman CohenMeasuring the Designer Experience
October 23, 2019
"Slack channels with live feeds and tagging let busy developers catch key observations asynchronously."
Joanna Vodopivec Prabhas PokharelOne Research Team for All - Influence Without Authority
March 9, 2022
"We need to reject the notion that work is our only identity."
Tess DixonC'mon Get Happy
September 29, 2021
"The real question is who's gonna be using this dashboard and what questions are they trying to answer."
Theresa NeilJust Build Me a Dashboard!
April 9, 2019
"Working for large companies became frustrating because politics and procedures pulled me away from the research I love."
Kayla Farrell Chelsey Glasson Sean Fitzell Jared LeClercWhat It's Like To Be a User Researcher at Compass
March 12, 2021
