Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
Jake Burghardt
Stop wasting research: Unlock more value from research insights
2025 • Rosenfeld Community
Nalini P. Kotamraju
An Organizational Story: Salesforce Lightning Design System
2016 • Enterprise UX 2016
Gold
Sylvie Abookire
A Civic Designer's Guide to Mindful Conflict Navigation
2022 • Civic Design 2022
Gold
George Abraham
Design Systems To-Go: Introducing a Starter Design System, and Indigo.Design Overview (Part 1)
2021 • DesignOps Summit 2021
Gold
Jeff Gothelf
The Intersection of Lean and Design
2019 • Enterprise Community
Megan Kierstead
You Are a Badass at UX: Overcoming Imposter Syndrome
2021 • Advancing Research 2021
Gold
How to Identify and Increase your "Experience Quotient"
2018 • Enterprise Experience 2018
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Bud Caddell
Theme 2 Intro
2021 • DesignOps Summit 2021
Gold
Chris Geison
What is Research Strategy?
2021 • Advancing Research 2021
Gold
David Conrad
The Feeling of Data
2023 • Enterprise Community

More Videos

Brigette Metzler

"Research ops is not just about delivering efficiency; it’s about creating a map and a vision of research across the whole organization."

Brigette Metzler

Scaling ResearchOps: Helping Researchers do Their Best Work

March 30, 2020

Jon Fukuda

"There’s no future without craft—craft is the foundation for all the operational work that follows."

Jon Fukuda Jake Burghardt Jose Coronado Natalie Dunbar Denise Tilles

All the Ops: Successful cross-functional collaboration

September 10, 2025

Weidan Li

"I tried different prompts and roles, but they didn’t fundamentally improve ChatGPT’s ability to generate meaningful frameworks."

Weidan Li

Qualitative synthesis with ChatGPT: Better or worse than human intelligence?

June 4, 2024

Cennydd Bowles

"The harms of technology typically fall on non-users and worse-off groups in society."

Cennydd Bowles

Responsible Design in Reality

June 9, 2021

Stephen Anderson

"Specialists would rather share their toothbrush than their language."

Stephen Anderson

Puzzled? How to Coordinate Humans for Complex Challenges

May 27, 2021

Francesca Barrientos, PhD

"Team members told me they felt really seen for the first time during these discussions."

Francesca Barrientos, PhD

You Need Your Own Definition of Design Maturity

June 8, 2022

Ovetta Sampson

"Speculative research requires participatory methods, putting people into future scenarios, because people often can't articulate what they will want."

Ovetta Sampson

Research in the Automated Future

March 11, 2022

Juhan Sonin

"If you get eight people who give a crap together, you can start a federal agency."

Juhan Sonin

Design Now! The Agenda for Action

September 4, 2025

Nathan Shedroff

"Use tools that present your work visually and professionally because grounded-looking research is taken more seriously."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020