Summary
Documentation technology is the foundation of modern healthcare delivery. Convoluted, redundant, and excessive documentation is a pervasive problem that causes inefficiency in all aspects of the industry. At IncludedHealth, we are developing an AI-assisted documentation that summarizes and documents conversations between patients and their care providers. A care provider can push one button and have their entire patient encounter captured in a succinct and standardized format. Upon a pilot launch, the results were staggering. Within 6 months, we demonstrated a 64% reduction in time per encounter! However, despite our promising results, there still remain challenges specific to the demands of the healthcare domain. As our team continues to develop solutions to meet these challenges, we gain even more clarity on what it takes to design a human-backed, AI-powered healthcare system. Takeaways From this session, you can expect to learn the following: Developing AI design in healthcare requires close collaboration between end users and your data science team Piloting GenAI solutions may be more effective than traditional prototyping Trading accuracy for efficiency is a barrier to adopting GenAI tools in healthcare GenAI design in healthcare requires establishing critical boundaries as well as a good understanding of cognitive processing Other factors to consider when designing AI solutions for service-based industries are understanding how training might be impacted, the importance of standardization vs. personalization of data output and the need for more autonomy and control elements due to consequences of unpredictable output errors
Key Insights
-
•
Generative AI can significantly reduce documentation time in healthcare settings.
-
•
Collaboration among designers, data scientists, and clinicians is essential for successful AI tool development.
-
•
Initial excitement about AI tools can fade if the tools don't meet users' evolving expectations.
-
•
It’s crucial to balance efficiency and accuracy when designing AI solutions.
-
•
AI is not a one-size-fits-all solution; its applications must be tailored to specific use cases.
-
•
Understanding user needs is vital for effective AI integration into workflows.
-
•
Feedback mechanisms, such as measuring edit rates, help assess AI tool performance.
-
•
Documentation quality evaluation metrics may need reevaluation when introducing AI tools to users.
-
•
Human oversight is necessary to maintain quality and manage cognitive biases toward AI outputs.
-
•
AI tools should be positioned as augmentative rather than fully autonomous solutions.
Notable Quotes
"AI is a unique design material that designers must ensure is used correctly."
"Our company combines virtual care, clinician-led care navigation, and patient advocacy to enhance healthcare access."
"Healthcare documentation is rife with inefficiencies; a physician can spend up to two hours documenting for every one hour with a patient."
"We've seen documentation time reduced by 64% since implementing our AI tool."
"AI is perfect for addressing documentation as it is tedious and mentally taxing for humans."
"Our design process changed to accommodate the unpredictable nature of AI outputs."
"The highest rated combinations of model parameters were chosen based on human evaluation of AI-generated notes."
"Traditional prototyping methods were ineffective; we learned through incremental pilots instead."
"We're discovering that user sentiment towards AI tools can shift over time, influenced by performance expectations."
"It's critical to reinforce users' understanding that AI tools are augmentative rather than standalone solutions."
More Videos
"We are definitely kind of feeling out some phases."
Jacqui FreyFlow and Superfluidity for Design Orgs
November 7, 2018
"To foster engagement, using emojis and gifs can add the tone and body language that are often missed in text."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"Confirmation bias makes it harder to be open-minded when interpreting research data."
Johanna KollmannInsights-Driven Product Strategy: Get your Research to Count
December 6, 2022
"Take advantage of our sponsor sessions because they are really high quality and free."
Bria AlexanderDay 3 Welcome
September 25, 2024
"Designing for an edge case can benefit everyone."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022
"When expectations are low for process, it’s the perfect opportunity to rifle through new approaches."
Catherine DubutBridging Physical and Digital Spaces: Approaches to Retail Service Design
March 18, 2021
"The V2Mom framework helps us align our personal and company values effectively."
Kim Holt Emma Wylds Pearl Koppenhaver Maisee XiongA Salesforce Panel Discussion on Values-Driven DesignOps
September 8, 2022
"90% of everything is crud, including the people we work alongside."
Adrian HowardSturgeon’s Biases
September 25, 2024
"I learned that design is a spoke on a wheel and that I had to stick to the brief, obey the chain of command and deliver polished pixel perfect designs."
Asia HoePartnering with Product: A Journey from Junior to Senior Design
November 29, 2023
