Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
Marc Rettig
Discussion
2015 • Enterprise UX 2015
Gold
Shreya Dhawan
Making service tangible: the fastest path to higher performance
2025 • Advancing Service Design 2025
Gold
Sean Fitzell
Craft of User Research: Building Out Jobs to be Done Maps
2021 • Advancing Research 2021
Gold
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Lavrans Løvlie
Ask me anything – Authors of Service Design: From Insight to Implementation
2025 • Advancing Service Design 2025
Gold
Weidan Li
Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Josina Vink
Navigating the pitfalls of systems thinking in service design
2024 • Advancing Service Design 2024
Gold
Mariah Hay
Ethics in Tech Education: Designing to Provide Opportunity for All
2018 • Enterprise Experience 2018
Gold
Sarah Fathallah
Lessening the Research Burden on Vulnerable Communities
2020 • Advancing Research 2020
Gold
Sam Proulx
Prototype Reviews, People With Disabilities, and You
2021 • Civic Design 2021
Gold
Carol Smith
Operationalizing Responsible, Human-Centered AI
2023 • Enterprise UX 2023
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • DesignOps Summit 2025
Gold
Christian Rohrer
Research Operations at Scale
2017 • DesignOps Summit 2017
Gold
Joshua Graves
We Need To Talk: Managing Ludicrous Requests at Work (Part 3 of 3)
2025 • Rosenfeld Community

More Videos

Joseph Williams

"Mentorship was rare and often tied to paid programs; sponsorship was nonexistent in my career path."

Joseph Williams Nepani Birondo Matt Readman Allison Ngo

Unlocking impact and influence through inclusive hiring in research

December 16, 2021

Bria Alexander

"We can make ourselves and our practice better because of what we’ve learned on our journeys of resilience."

Bria Alexander

Theme 1 Intro

September 23, 2024

Erin Weigel

"If you don’t test, you’re relying on opinion, which can drastically degrade the customer experience."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024

Jacqui Frey

"Design ops is not just about design; if we aren’t considering the system, then we’re destined to fail."

Jacqui Frey Alison Rand

Setting the Table for Dynamic Change

October 24, 2019

Kate Towsey

"Research waste turns into research wealth when insights are properly activated inside organizations."

Kate Towsey Jake Burghardt

ResearchOps AMA with Kate Towsey & Jake Burghardt

October 16, 2025

Maish Nichani

"Narrative shapes identity and inspires action. Amazon’s Day One narrative shows how overarching stories guide hiring, projects, and failure mindset."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021

Yunyan Li

"Building trust in the user is fundamental, especially in digital products like our doggy daycare app example."

Yunyan Li Anna Le Jen Kim

UX Best Practices

June 11, 2021

Bria Alexander

"Yesterday was a lot of fun, but today is going to be even more fun."

Bria Alexander

Opening Remarks

June 10, 2021

Dantley Davis

"Designers who come out of US tech need to pivot quickly toward broader inclusion or risk being outpaced by other markets."

Dantley Davis

Leadership & Diversity—A Fireside Chat with Dantley Davis

September 17, 2020