AI’s Rising Use in Healthcare: Nurses Alert on Patient Safety Risks

232

TL/DR –

Kaiser Permanente, a major employer in San Francisco, is an early adopter of AI in healthcare and has a program in place that uses AI to alert nursing teams when a patient’s health is at risk. However, there have been issues with the AI tool producing inaccurate alarms or failing to detect serious health declines in patients. Critiques suggest that AI tools should not replace human assessments, and policies should be developed that ensure the safe use of AI in health services and promote the welfare of patients and workers.


AI in Healthcare: Kaiser Permanente’s Approach and Nurses’ Concerns

Major Bay Area employer, Kaiser Permanente, adopts AI early and tests tools rigorously for safety, accuracy, and fairness. Their approach, which places medical professionals and care teams at the heart of decision-making, seeks to utilize AI in enhancing patient experience and supporting workforce. Kaiser Permanente emphasizes that AI complements human assessment rather than replacing it.

One of the AI tools, Advance Alert Monitor, is used in 21 Kaiser hospitals in Northern California. It analyses electronic health data and alerts nursing teams about the potential serious decline in a patient’s health, reportedly saving around 500 lives annually.

Nurses Rally for Patient Safety in AI Applications

AI’s Rising Use in Healthcare: Nurses Alert on Patient Safety Risks

However, some nurses have raised concerns about inaccuracies and detection failures of the AI tool. They emphasize that patient safety shouldn’t be compromised for managing patient load. Gutierrez Vo, a nurse with 25 years of experience at Kaiser’s Fremont Adult Family Medicine clinic, comments that patients are not “lab rats” for AI systems.

Regulation Challenges and Future Prospects of AI in Healthcare

While the U.S. Food and Drug Administration has authorized some AI services, comprehensive data is often not required, unlike new medicines. President Joe Biden has issued an executive order for safe AI use, promoting patient and worker welfare.

Dr. Ashish Atreja, Chief Information and Digital Health Officer at UC Davis Health, believes in open discussions about AI. He states that while many health systems have AI guardrails, these are not widely known, leading to a knowledge gap.

A Balanced Approach to AI in Healthcare

Healthcare workers advocating for balanced AI usage

UC Davis Health is part of a collaboration to implement generative AI types with “intentionality” to support their workforce and improve patient care.

Former Kaiser Permanente CEO, Dr. Robert Pearl, acknowledges the potential threats and benefits of AI. He states that patient welfare should be paramount and compares AI’s potential impacts to the iPhone, suggesting it’s here to stay.


Read More Health & Wellness News ; US News