Summary
Documentation technology is the foundation of modern healthcare delivery. Convoluted, redundant, and excessive documentation is a pervasive problem that causes inefficiency in all aspects of the industry. At IncludedHealth, we are developing an AI-assisted documentation that summarizes and documents conversations between patients and their care providers. A care provider can push one button and have their entire patient encounter captured in a succinct and standardized format. Upon a pilot launch, the results were staggering. Within 6 months, we demonstrated a 64% reduction in time per encounter! However, despite our promising results, there still remain challenges specific to the demands of the healthcare domain. As our team continues to develop solutions to meet these challenges, we gain even more clarity on what it takes to design a human-backed, AI-powered healthcare system. Takeaways From this session, you can expect to learn the following: Developing AI design in healthcare requires close collaboration between end users and your data science team Piloting GenAI solutions may be more effective than traditional prototyping Trading accuracy for efficiency is a barrier to adopting GenAI tools in healthcare GenAI design in healthcare requires establishing critical boundaries as well as a good understanding of cognitive processing Other factors to consider when designing AI solutions for service-based industries are understanding how training might be impacted, the importance of standardization vs. personalization of data output and the need for more autonomy and control elements due to consequences of unpredictable output errors
Key Insights
-
•
Generative AI can significantly reduce documentation time in healthcare settings.
-
•
Collaboration among designers, data scientists, and clinicians is essential for successful AI tool development.
-
•
Initial excitement about AI tools can fade if the tools don't meet users' evolving expectations.
-
•
It’s crucial to balance efficiency and accuracy when designing AI solutions.
-
•
AI is not a one-size-fits-all solution; its applications must be tailored to specific use cases.
-
•
Understanding user needs is vital for effective AI integration into workflows.
-
•
Feedback mechanisms, such as measuring edit rates, help assess AI tool performance.
-
•
Documentation quality evaluation metrics may need reevaluation when introducing AI tools to users.
-
•
Human oversight is necessary to maintain quality and manage cognitive biases toward AI outputs.
-
•
AI tools should be positioned as augmentative rather than fully autonomous solutions.
Notable Quotes
"AI is a unique design material that designers must ensure is used correctly."
"Our company combines virtual care, clinician-led care navigation, and patient advocacy to enhance healthcare access."
"Healthcare documentation is rife with inefficiencies; a physician can spend up to two hours documenting for every one hour with a patient."
"We've seen documentation time reduced by 64% since implementing our AI tool."
"AI is perfect for addressing documentation as it is tedious and mentally taxing for humans."
"Our design process changed to accommodate the unpredictable nature of AI outputs."
"The highest rated combinations of model parameters were chosen based on human evaluation of AI-generated notes."
"Traditional prototyping methods were ineffective; we learned through incremental pilots instead."
"We're discovering that user sentiment towards AI tools can shift over time, influenced by performance expectations."
"It's critical to reinforce users' understanding that AI tools are augmentative rather than standalone solutions."
















More Videos

"Our discipline is about helping companies make better decisions, even if it means saying no to existing projects."
Mike OrenWhy Pharmaceutical's Research Model Should Replace Design Thinking
March 28, 2023

"I thought I was in a much better position to persuade from a position of influence based on my experiences in the craft."
Edward CuppsThe Principal Path: Journeying from Management to Individual Contributor
June 11, 2021

"You can measure the success of your team by the behavior changes in your users."
Jeff GothelfThe Intersection of Lean and Design
January 10, 2019

"From the outside, enterprises look entirely different"
Dan WillisTheme 3: Intro
January 8, 2024

"Happier designers lead to lower attrition rates."
Kristin Skinner Kamdyn MooreGroup Activity: A Deep Dive Into Value and Outcomes
October 23, 2019

"Experimenting with AI has completely changed my excitement for design work."
John DonmoyerShipping your code generation experiments to production
June 11, 2025

"My job was to find out why. Why was he frowning? Why was he sighing?"
Susan Simon-DanielsWar Stories LIVE! Susan Simon-Daniels
March 30, 2020

"When agencies have been certified, they're put into a database that you can search."
Emily LessardRFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
December 9, 2021

"One voice counts and one difficult voice can change the world."
Robin Beers Nalini Kotamraju Andy WarrPanel: Excellence in Communicating Insights
March 26, 2024