Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Rikki Teeters
Concept to code: Transforming ideas into functional products with Kiro
2026 • Designing with AI 2026
Conference
Marc Majers
Interrupted UX - Add A Dose of Reality To Usability Testing
2022 • Advancing Research 2022
Gold
Victor M. Gonzalez
Practicing Learners and Learning Practitioners
2021 • Advancing Research 2021
Gold
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Cheryl Platz
Merging Improv with Design
2019 • Enterprise Community
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Kevin Bethune
Reimagining Design: Unlocking Strategic Innovation
2022 • Design at Scale 2022
Gold
Shipra Kayan
How Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro 
2021 • DesignOps Summit 2021
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Michelle Chin
The DesignOps Starter Kit
2021 • DesignOps Summit 2021
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Kara Kane
Communities of Practice for Civic Design
2022 • Civic Design Community
Dalia El-Shimy
So You've Got a Seat at the Table. Now What?
2020 • Advancing Research 2020
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young
2019 • Advancing Research Community
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold

More Videos

Alba Villamil

"Using the umbrella term 'people of color' erases the most disadvantaged and privileges the least burdened."

Alba Villamil

Stereotyped by Design: Pitfalls in Cross-Cultural User Research

March 30, 2020

Jacqui Frey

"We love small teams because we move fast and break things and figure things out on the fly."

Jacqui Frey Dan Willis

Panel Discussion: Integrating DesignOps

November 7, 2018

Maria Giudice

"We created Tiger teams that work like cancer cell hunters, targeting isolated problems and then dissolving after their work is done."

Maria Giudice

Remaking the Making Company: Moving from Product to Experience

June 9, 2016

Mansi Gupta

"Start every project by asking What about women?"

Mansi Gupta

Women-Centric Research: What, Why, How

March 29, 2023

Marisa Bernstein

"Use plain language in all communication. No design or technology jargon."

Marisa Bernstein

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

December 9, 2021

Margot Bloomstein

"Inconsistency stokes cynicism; consistency helps bolster our faith in the world."

Margot Bloomstein

Fostering Trust in Your Brand and Beyond

March 12, 2020

Matt Bernius

"Compensation should be culturally competent and consider all supports participants might need to show up fully."

Matt Bernius Rachael Dietkus, LCSW Aditi Joshi Alba Villamil

Learnings from Applying Trauma-Informed Principles to the Research Process

March 10, 2022

Louis Rosenfeld

"The Rosen Bot is narrow in scope, just UX and product design content that's super high quality."

Louis Rosenfeld

GenAI for UXers: A Rosenbot Demo and Discussion

June 11, 2025

Angy Peterson

"Personalization at scale is made possible by capturing activity data and correlating it across millions of residents."

Angy Peterson Bob Ainsbury

More Than Technology: Personalized Public Sector Experiences

December 10, 2021