The New York State Legislature convened on September 20, 2024, to discuss critical issues surrounding consumer protection and safety in the context of artificial intelligence (AI). The meeting featured expert testimonies focusing on the implications of generative AI technologies, particularly concerning user safety and privacy.

Siwei Wu, a university professor with over 20 years of AI research experience, highlighted the rapid advancements in generative AI, which can create realistic text, images, audio, and video. He noted that while these technologies offer significant benefits, they also pose serious risks, particularly through the creation of deceptive content known as "deepfakes." These AI-generated materials can be used for scams, identity theft, and the spread of misinformation, leading to reputational damage and financial loss for consumers.

Wu emphasized the urgent need for regulatory measures to mitigate these risks. He proposed that AI companies should implement safeguards such as content authentication and digital watermarking to track the origin and authenticity of digital files. Additionally, he suggested that the release of generative AI tools should be accompanied by measures to detect and verify content, as well as stronger filters on social media platforms to identify and label deepfakes.

The meeting underscored the importance of holding individuals or organizations accountable for creating and disseminating harmful AI-generated content. Wu also called for increased support for research into counter-technologies and public education initiatives to raise awareness, particularly among vulnerable populations.

As the generative AI industry continues to grow, with a projected annual growth rate of over 25% in the next five years, the discussions at this meeting signal a critical step towards ensuring consumer safety and protecting against the misuse of AI technologies. The legislature's commitment to addressing these challenges will be vital in shaping a safer digital landscape for all consumers.