The Assembly Joint Hearing Health Committee and Privacy and Consumer Protection Committee convened on May 28, 2025, to discuss the implications of artificial intelligence (AI) in healthcare, particularly focusing on maternal health and the accuracy of predictive tools. The meeting highlighted the need for human oversight in AI applications to ensure patient safety and equitable care.

A significant topic of discussion was the accuracy of AI tools used for predicting medical outcomes, such as the likelihood of cesarean sections. One expert noted that while their prediction tool boasts a 90% accuracy rate, it is crucial to understand that these tools should not dictate medical decisions but rather serve as supplementary information for healthcare providers. Concerns were raised about the potential for increased cesarean rates if physicians overly rely on AI outputs without considering individual patient circumstances.

The committee also addressed the critical issue of bias in AI systems, particularly regarding maternal mortality rates among women of color. Legislators emphasized the importance of testing these tools against diverse patient populations to ensure they do not reinforce existing disparities in healthcare outcomes. One member expressed the need for robust governance and compliance measures to monitor the effectiveness of AI tools in improving care for marginalized groups.

Additionally, the discussion touched on the broader implications of AI in healthcare access. Experts warned that while large healthcare organizations may benefit from advanced AI technologies, there is a risk that underserved populations could be left behind. Ensuring equitable access to AI benefits for all patients, including those in rural areas and federally qualified health centers, was identified as a priority.

The meeting concluded with a call for ongoing evaluation of AI tools to ensure they are enhancing, rather than hindering, healthcare equity. Legislators expressed a commitment to pushing for improvements in maternal health outcomes and addressing systemic biases within healthcare systems. The discussions underscored the importance of balancing technological advancements with the need for human oversight and ethical considerations in healthcare delivery.