AI experts discuss ethical use and accountability in technology deployment

Artificial intelligence (AI) took center stage at the Raleigh City Council Work Session on March 18, 2025, as officials discussed the urgent need for ethical guidelines and safeguards in its deployment. The conversation highlighted the rapid advancement of AI technologies and the potential risks posed by "bad actors" who may exploit these tools for malicious purposes.

Council members emphasized the importance of being proactive in establishing policies that govern AI use, particularly in light of recent incidents involving deep fakes and biased outputs. One member recounted a troubling example from a past election where a deep fake video misrepresented a candidate's statements, underscoring the need for legislative protections against such manipulations.

The discussion also touched on the implications of AI-generated content, including privacy concerns. Officials warned that once information is fed into AI systems like ChatGPT, it becomes part of the model's data, raising questions about the security of sensitive city information. The council stressed the necessity of implementing "guardrails" to prevent the misuse of data and to ensure that AI outputs are accurate and unbiased.

A significant point raised was the legal accountability of AI systems. An example was shared about an airline that faced a lawsuit due to incorrect information provided by an AI agent, resulting in a court ruling in favor of the affected customer. This incident highlighted that AI-generated responses carry the same legal weight as those given by humans, reinforcing the need for human oversight in AI interactions.

As the council moves forward, they are developing a comprehensive policy that outlines the dos and don'ts of AI usage. This policy aims to ensure that human judgment remains central to AI applications, particularly in verifying the accuracy and fairness of AI-generated information. The council is committed to transparency and accountability, recognizing that the community's safety and trust hinge on responsible AI practices.

In conclusion, the Raleigh City Council's discussions reflect a growing awareness of the complexities surrounding AI technology. As they work to establish ethical guidelines, the emphasis remains on safeguarding the public and ensuring that AI serves as a beneficial tool rather than a source of misinformation or harm.