Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Why do so many metrics include the word “Key”? How do those metrics differ, and how do teams and organizations decide which key metric is best for them? Join this DesignOps community discussion to compare different types of three letter acronym metrics such as KPI, KEI, and KSP (Key Performance Indicator, Key Experience Indicator, and Key Strategic Priorities). And let's not forget OKR's (Objectives and Key Results)!
Key Insights
-
•
Nicole emphasizes linking accessibility initiatives to corporate Key Strategic Priorities to demonstrate business value beyond compliance.
-
•
Shashi's KPI Compass framework categorizes innovation metrics into quadrants balancing leading/lagging and thought leadership/impact.
-
•
Key Experience Indicators (KEIs) are distinct from KPIs and focus on user-centered measures that predict experience failure risks.
-
•
Measuring behavior change is crucial to predicting innovation success, not just tracking final business metrics.
-
•
Consistency in metrics terminology and templates across teams helps avoid sidetracking conversations with engineering partners.
-
•
Canary indicators identify critical experience fail points that can doom a product if not monitored carefully.
-
•
Strategic priorities, like Hilton’s KSPs, tend to remain stable over years to guide multi-year initiatives reliably.
-
•
Storytelling and communication training are vital for teams to convey the value of accessibility and design work aligned with business objectives.
-
•
In ambiguous or innovative contexts, metrics should remain a conversation starter rather than imposed fixed covenants.
-
•
Using user and market feedback can shift early metrics from vanity measures (like downloads) to meaningful adoption and usage data.
Notable Quotes
"If we are working on something that does not ladder up to our KSPs, then we should not be working on it."
"The canary in the coal mine—that’s how we identify the fail points in the user experience we absolutely can’t miss."
"Innovation is invention multiplied by adoption multiplied by inclusion."
"Metrics are always a conversation, they shouldn’t be a covenant."
"Adoption is the only thing that matters in innovation. If you’re not changing behavior, you haven’t innovated."
"Key is a reminder that these metrics reflect what is authoritative and important to the customer and the business."
"If you only measure vanity metrics like downloads, you risk tracking numbers that don’t translate to real usage or value."
"Our KSPs do not change year over year because changing them frequently is disruptive for the business direction."
"We use storytelling to turn accessibility from just compliance into a business differentiator that executives care about."
"When there’s dispute over what to measure, use that as an opportunity to discuss the behavior you want to change and the value capture."
Or choose a question:
More Videos
"We openly talk about burnout and mental health so people feel comfortable reaching out when they need to."
Ana FerreiraDesigning Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
January 8, 2024
"Some people said I don’t think I’m qualified enough to observe research sessions despite training."
Roy Opata OlendeHow Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
August 6, 2020
"Designers often come out of schools without ever doing competitive analysis or considering existing design patterns."
Kit Unger Jackie Ho Veevi Rosenstein Vasileios XanthopoulosTheme 2: Discussion
January 8, 2024
"We focused on consolidating frameworks and landed on Canvas, which now supports 45 teams and growing."
Abbey Smalley Sylas SouzaScaling UX Past the Size of Your Team
January 8, 2024
"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."
Helen ArmstrongAugment the Human. Interrogate the System.
June 7, 2023
"Collaboration with participants via video is possible even in constricted remote or hybrid work environments with the right methods."
Bas Raijmakers, PhD (RCA) Charley Scull Prabhas PokharelWhat Design Research can Learn from Documentary Filmmaking
March 11, 2022
"A growth mindset in research means being ready to adapt protocols based on what actually works with participants."
Mila Kuznetsova Lucy DentonHow Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
March 9, 2022
"ChatGPT’s approach in analogy generation segmented the narrative into unrelated metaphors, which confused the overall story."
Weidan LiQualitative synthesis with ChatGPT: Better or worse than human intelligence?
June 4, 2024
"Product manager is not the CEO of the product and I don’t think that’s a very helpful metaphor."
Christian CrumlishAMA with Christian Crumlish, author of Product Management for UX People
March 24, 2022
Latest Books All books
Dig deeper with the Rosenbot
What challenges and stressors do service designers face as the organizational 'glue' and leaders?
What are effective ways to include people with disabilities in generative and usability research?
What are small steps teams can take to start making meaningful inclusive research without large-scale studies?