Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Farid Sabitov
Theme Four Intro
2022 • DesignOps Summit 2022
Gold
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Kristin Skinner
8 Types of Measures in Design Operations
2020 • DesignOps Community
Doug Powell
Closing Keynote: Design at Scale
2018 • DesignOps Summit 2018
Gold
Emilia Åström
Unlock Your Team’s Intelligence with Collaboration Design
2022 • Design at Scale 2022
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Gordon Ross
12 Months of COVID-19 Design and Digital Response with the British Columbia Government
2021 • Civic Design 2021
Gold
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold
Courtney Kaplan
Taking it to the next level: Career paths in DesignOps
2018 • DesignOps Summit 2018
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Greg Petroff
The Compass Mission
2021 • Advancing Research 2021
Gold

More Videos

Harry Max

"Priorities don't necessarily need to be in a list but even unspoken priorities drive the work that's getting done."

Harry Max

Priority Zero: Some Things are More Equal than Others

June 9, 2016

Jemma Ahmed

"We need to democratize insights, not just democratize research."

Jemma Ahmed Subhasree Chatterjee Robert Fabricant Alexandra Jayeun Lee Ben Robins

Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]

August 7, 2024

Iulia Cornigeanu

"Big data tells you what is happening; small data explains why it’s happening."

Iulia Cornigeanu

QuantQual Book Club: Small Data

March 8, 2024

Rachael Greene

"Getting to know someone as a person first—the vibe check—is the first step to successful UX research collaboration."

Rachael Greene Alison Davis

Building a Design Ops Practice that Really Works (Most of the Time)

October 2, 2025

Sarah Auslander

"Civic action as proof of concept to get government moving, to get the wheels turning was really interesting."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022

Sharbani Dhar

"Quick agile experiments made experiences technically feasible but led to tech-heavy solutions with little customer focus."

Sharbani Dhar

Breathing Room for Delight

January 8, 2024

Llewyn Paine

"Today’s speakers come from real world companies facing real consequences for their choices about AI."

Llewyn Paine

Day 1 Using AI in UX with Impact

June 10, 2025

Elizabeth Churchill

"The CEO wanted rapport, not just productivity, and the collaborative poster created that from scratch."

Elizabeth Churchill

Exploring Cadence: You, Your Team, and Your Enterprise

June 8, 2017

Dan Ward

"Innovation is novelty with impact—something new that makes a meaningful difference."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025