On May 28, 2025, the Assembly Joint Hearing Health Committee and the Privacy and Consumer Protection Committee convened in California to discuss pressing issues in healthcare, particularly the implications of artificial intelligence (AI) in the sector. The meeting highlighted significant concerns regarding data bias and the equitable use of AI technologies, especially for vulnerable communities.

A key discussion point centered on the inherent biases present in healthcare data, which can adversely affect AI training and outcomes. Experts emphasized that while many organizations claim to implement bias detection, the methods remain unclear and the technology is still developing. The speaker noted that California, with its diverse population and technological resources, is uniquely positioned to lead in addressing these challenges. There is a pressing need for data that accurately represents all communities, particularly those in safety net systems, to ensure equitable access to AI advancements.

The conversation also touched on the risks faced by safety net communities, which may lack the resources to effectively engage with AI technologies. The speaker argued that these communities should be involved in the training of AI models to ensure their needs are represented, thereby reducing bias in AI applications. However, the availability of relevant data, particularly from Medicaid and Medi-Cal, remains a significant barrier, as many model developers overlook these populations.

Amy McDonough from Google further elaborated on the transformative potential of AI in healthcare. She outlined Google's commitment to harnessing technology to improve health outcomes, emphasizing the importance of providing accessible health information and developing AI tools that address real-world challenges faced by healthcare systems. McDonough highlighted the need for responsible AI development, ensuring that models are trained on diverse and culturally relevant data to enhance safety and fairness.

The meeting underscored the urgent need for collaboration between technology developers and healthcare providers to create solutions that are inclusive and effective. As California navigates these complex issues, the discussions signal a critical step towards leveraging AI to improve healthcare delivery while addressing the systemic biases that currently exist. The anticipated next steps include further exploration of data governance and the integration of diverse datasets to foster equitable healthcare solutions.