On May 28, 2025, the Assembly Joint Hearing Health Committee and Privacy and Consumer Protection Committee convened in California to discuss the implications of artificial intelligence (AI) in healthcare. The meeting highlighted significant concerns regarding the integration of AI tools in primary care, health equity, and patient rights.
A key topic of discussion was the disparity in AI tool approvals across various medical fields. Experts noted that while AI applications in radiology, cardiology, and dermatology have seen substantial advancements, primary care remains largely underserved. This gap raises concerns about health equity, as the lack of AI solutions in primary care could exacerbate existing disparities in healthcare access and quality. Stakeholders emphasized the need for leadership to incentivize developers to focus on primary care, where AI could have the most significant impact on population health.
Brenton Hill, representing the Coalition for Health AI, outlined four critical issues the organization is addressing. These include the need for transparency in AI applications, the uneven readiness of health systems to adopt AI, insufficient validation of AI tools, and the fragmented regulatory landscape. Hill advocated for standardized disclosure frameworks, such as model cards, to enhance transparency and urged the legislature to support inclusive data practices that would benefit under-resourced health centers.
David Ford, CEO of CMA Physicians Services, highlighted the potential of AI to streamline administrative tasks and improve clinical outcomes. However, he warned of a looming federal moratorium on state regulation of AI systems, which could hinder progress in ensuring safe and equitable AI deployment in healthcare settings, particularly for smaller practices and community health centers.
Christine von Raesfeld, a board member of the Light Collective, stressed the urgent need for patient protections in AI-driven healthcare. She presented the Patient AI Rights Initiative, which aims to establish enforceable rights for patients, ensuring their voices are included in AI governance. Key components of this initiative include transparency in AI decision-making, robust privacy measures, and legal recourse for patients affected by AI errors.
The discussions at this hearing underscore the critical intersection of technology, healthcare, and patient rights. As AI continues to evolve, the need for comprehensive policies that prioritize equity, transparency, and patient involvement becomes increasingly urgent. The committee's next steps will likely involve drafting legislation to address these pressing issues, ensuring that the benefits of AI in healthcare are accessible to all Californians.