Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Edward Cupps
The Principal Path: Journeying from Management to Individual Contributor
2021 • Design at Scale 2021
Gold
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Peter Van Dijck
Hands-on AI #1: Let’s write your first AI eval
2025 • Rosenfeld Community
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Joi Freeman
A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
2020 • Advancing Research 2020
Gold
Jules Monza
Use These Words and Count These Things
2024 • DesignOps Summit 2024
Gold
Kara Kane
Communities of Practice for Civic Design
2022 • Civic Design Community
Boon Yew Chew
Making Sense of Systems—and Using Systems to Make Sense of the Enterprise
2023 • Enterprise UX 2023
Gold
Amahra Spence
Designing for Liberation, Rehearsing Freedom
2022 • Civic Design 2022
Gold
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Liwei Dai
The Heart and Brain of the AI Research
2020 • Advancing Research 2020
Gold
Russell Blair
Killing the blank page
2024 • Designing with AI 2024
Gold
Robin Beers
Beyond Insights: Researchers as Organizational Change Catalysts
2024 • Advancing Research 2024
Gold

More Videos

Sheryl Cababa

"Evaluating interventions must loop back to expand understanding of consequences and radiating effects."

Sheryl Cababa

Expanding Your Design Lens with Systems Thinking

February 23, 2023

Caitlyn Hampton

"At IBM, projects felt like following a recipe, but at Compass, I can promote my ideas and see how they work, which is very satisfying."

Caitlyn Hampton Monica Lee Jina Yoon

Compass 101: Growing Your Career In A Startup World

June 11, 2021

Silke Bochat

"When have you hired the last time someone over 50 or someone who is disruptive and not just culture fit? You need those complementary people."

Silke Bochat

5 Antifragile Strategies for a DesignOps 2.0

September 23, 2024

Christian Rohrer

"Most executives think user research is big numbers good, small numbers bad, or focus groups with M&Ms."

Christian Rohrer

Insight Types That Influence Enterprise Decision Makers

May 13, 2015

Jaime Creixems

"Iteration is the golden rule of design, including iterating on your design system rules themselves."

Jaime Creixems

Best Practices when Creating and Maintaining a Design System

June 7, 2023

Jeff Gothelf

"Nordstrom decided that innovation needed to be a corporate value, not a lab value."

Jeff Gothelf

Innovation Studios: the Engines of Enterprise Experimentation

May 14, 2015

Josh Clark

"AI is supposed to make things easier, but it usually comes on with some knock on problems."

Josh Clark Veronika Kindred

Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)

February 12, 2025

Sarah Rink

"Remote is a design constraint, but what else can we do with it to improve practice?"

Sarah Rink

Remote User Research: Dos and Don'ts from the Virtual Field

June 11, 2020

Alexandra Schmidt

"Enterprise UX often pulls designers into adoption and training roles, even if that feels outside traditional design work."

Alexandra Schmidt

Enterprise UX Playbook

December 1, 2022