Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Making it Count: Developing a custom digital metric framework that works
Friday, October 15, 2021 • QuantQual Interest Group
Share the love for this talk
Making it Count: Developing a custom digital metric framework that works
Speakers: Alberto Ferreira
Link:

Summary

NPS, SUS, HEART, CSAT, CES, CLI—the list of ambiguous acronyms goes on and on. Companies are under more pressure than ever to measure and quantify their results and their interactions with customers, but finding the right metric and the right approach is a challenging process that risks leaving key factors behind as you commit to one sole standard. However, what if there is another way to measure digital transformation and how people see your services? This is what this presentation will focus on. You will learn how to navigate the pitfalls of standardized metrics—with their pros and cons—and learn how to build and implement a custom metric framework that incorporates the best aspects of Net Promoter Score, Customer Effort Score, System Usability Scale, and other, into one cohesive and modern whole aimed at developing the actionability and traceability of your operations and customer services. Attendees takeaways include: how to develop a custom framework without losing benchmarking capability, identifying gaps and needs from this framework that is not focused solely on operational numbers, and how to wade through the murky waters of digital experience quantification. Bring your best questions and leave with actionable insights that you can put in use immediately.

Key Insights

  • Metrics should not be one-dimensional; they need to capture the multifaceted nature of user behavior.

  • NPS, while popular, can be misleading as it often fails to match true customer behaviors.

  • A user-centered digital metric framework must incorporate qualitative insights alongside quantitative measures.

  • Understanding the 'why' behind user ratings is crucial for developing effective metrics.

  • Tailor metrics to the specific context of user journeys rather than relying on standardized measures.

  • Balance the emotional aspects of UX with behavioral metrics to gain a comprehensive view of user satisfaction.

  • Involve storytelling in data reporting to communicate findings effectively to business leaders.

  • Experiment with different frameworks but maintain clarity and simplicity in the metrics used.

  • Focus on a select few metrics that can have real business impact instead of a long list of complex indicators. This simplifies communication with stakeholders.

  • Continuous assessment over time is key; metrics must be relevant and adaptable to changes in user behavior.

Notable Quotes

"A user-centered measurement should not be one dimensional."

"How deep do you go in assessing your data sets?"

"Metrics that are influenced by emotional factors can lead to skewed interpretations of user sentiment."

"A good metric should be valid and relative to the time period."

"There’s a gap in understanding why people rate their experiences the way they do."

"If NPS is going up, it doesn't necessarily indicate that customer sentiment is improving for all products."

"Benchmarking over time helps you see if those metrics remain relevant."

"The story behind the metrics is as important as the metrics themselves."

"When developing metrics, keep it simple so users don't have to overthink their answers."

"We measure sentiment not just by numbers, but also by the stories our users tell."

More Videos

April Reagan

"Every decision we make today influences those who will come after us."

April Reagan

Look, Think, Act: The Futures-Smart Design Organization

October 1, 2021

Dane DeSutter

"Gesture and embodied actions serve as a window into the embodied mind."

Dane DeSutter

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not

March 26, 2024

Tatyana Mamut

"The products you ship are direct reflections of your organizational processes."

Tatyana Mamut

Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart

June 3, 2019

Ana Maria Montero Barrantes

"I hope this song will put that to rest; it’s like an anthem for UX integration."

Ana Maria Montero Barrantes Aditi Dhar Michelle Kaplan Nate Osborne Matt Laurence

The Authentic UX Talent Show

January 8, 2024

Ned Gartside

"There's a significant difference between individual impact and the cumulative impact of millions of users."

Ned Gartside Mike Gifford Zoe Lopez-Latorre Tzviya Siegman

Navigating accessibility and climate

April 17, 2024

Sam Proulx

"Mobile offers a first-class experience for voice control, unlike many desktop systems."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

September 8, 2022

Melinda Belcher

"When you hire a consultant, you are hiring more for consulting, more for strategy."

Melinda Belcher

Insider preview of Enterprise Experience 2020

May 28, 2020

Christian Bason

"Civic design should not just respond to immediate needs but envision future thriving societies."

Christian Bason

Expand—Rethinking Design for Public Challenges

September 14, 2022

Ren Pope

"Most knowledge systems use force-directed graphs to present knowledge, but these lack standard design elements."

Ren Pope

Building Experiences for Knowledge Systems

June 6, 2023