Standardizing Product Merits for Leaders, Designers, and Everyone
Summary
The DesignOps team at Athenahealth has solved this problem by creating a standardized measurement framework—including qualitative and quantitative instruments—that helps product teams measure their concepts and solutions early and often. These are measures that leaders can use to make informed investment decisions across the larger portfolio, and that free product teams to be awesome at what they do: designing, managing, and developing products that lead to better experiences for users.
Key Insights
-
•
Scale should be measured by the quality and meaningful impact of design, not just quantity or organizational reach.
-
•
Lack of team agency in decision-making leads to unhealthy behaviors like cutting corners and skunk works projects.
-
•
Athena Health flourished initially due to government-subsidized demand rather than superior user experience.
-
•
Physicians using EHR systems often feel like clerks, frustrated by poor usability and forced workflows.
-
•
Enterprise software delusion occurs when companies succeed despite poor design due to weak competition and high switching costs.
-
•
Proving design impacts business outcomes requires identifying and analyzing key metrics like user retention and referrals.
-
•
Creating a shared design language involving product managers and subject matter experts fosters organizational alignment.
-
•
Systematic workflow audits guided by Jakob Nielsen’s heuristics can uncover actionable improvements to complex software.
-
•
Redesigning product decision-making to empower teams early in the process accelerates better pivot, shelve, or proceed calls.
-
•
Introducing self-serve experience measurement tools, including concept validation surveys, supports evidence-driven design iterations.
Notable Quotes
"Scale isn’t just about quantity, it’s about the quality and impact you have on organizational outcomes."
"So much change was killed just because leadership said so, and that really breaks my heart."
"Doctors don’t like using EHRs because it turns them into clerks; they’re engaging with a machine instead of a patient."
"You’re born on third base but think you hit a triple—that’s the enterprise software delusion."
"Users aren’t happy because they’re trapped; they have no sense of agency over the software they use."
"If design doesn’t move the needle, what needle are we even talking about? You have to find that needle."
"Creating a shared language lets others articulate design issues and makes design part of the conversation."
"Redesigning decision making means teams should have the autonomy to recommend pivot, shelve, or proceed earlier."
"We cut the claims editing process in half—four pages and 10 steps down to one page and four steps."
"Concept validation helps us spend time building useful things before making them work well."
Or choose a question:
More Videos
"Soap dispensers and water sensors often fail on darker skin because they rely on light reflection."
Nancy DouyonWe'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
June 15, 2018
"There’s a frustrating gap between what a designer envisions and what actually gets implemented, leaving live prototypes inconsistent."
Jack BeharHow to Build Prototypes that Behave like an End-Product
December 6, 2022
"A design project can become the catalyst for conversations where teams realize they have not talked to each other."
Jorge ArangoMeeting of the Waters: Designing for Successful Inorganic Growth
August 12, 2021
"If you’re in a big company, think smaller to work bigger — narrow your focus rather than get distracted by every shiny tool."
Jon White Erin MayUnsticking Research for Better Information Flow
March 11, 2026
"If someone asks you for a cup of coffee, here’s the cup of coffee. You did it. But always have proposals on the side for more."
Jessamyn EdwardsSurviving Your UX Career in Enterprise Design
December 2, 2021
"Injecting a culture of agile iteration sets the precedent that things can and will change as the team learns."
Stefanie OwensOptimizing for Outcomes: Transformation Design in Systems at Scale
December 4, 2024
"That friends is service experience in the 21st century."
Ron BronsonDesign, Consequences & Everyday Life
November 18, 2022
"The Rosen bot gives you sourced, clickable links to books and videos, so you can dig deeper."
Louis RosenfeldThe Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
June 5, 2024
"We're at a pivotal moment where technology can truly make a difference in sustainability."
Ash BrownSilver Linings: What DesignOps Learned in the Shift to WFH
October 23, 2020
Latest Books All books
Dig deeper with the Rosenbot
How can talking about AI without using the term help uncover the real capabilities and risks of the technology?
How can naming vulnerabilities in a team setting improve communication and accountability?
What roles can information architects and service designers play in the emerging field of AI context engineering?