Select Language:
It appears that the critical moment for AI chatbots has arrived. After multiple reports highlighting concerns about dangerous behaviors and tragic incidents involving children and teenagers interacting with these AI tools, the U.S. government is taking action. Today, the Federal Trade Commission (FTC) requested leading developers of popular AI chatbots to explain how they evaluate and ensure the appropriateness of these AI companions for kids.
### What’s unfolding?
The FTC emphasizes how tools like ChatGPT, Gemini, and those from Meta are capable of mimicking human conversations and fostering personal relationships. These AI chatbots often encourage trust and connection with young users. The agency now aims to better understand the safety measures these companies have in place and how they prevent potential harms to children and teens.
In a formal letter to major tech firms, including Meta, Alphabet (Google’s parent company), Instagram, Snap, xAI, and OpenAI, the FTC inquires about their target audiences, associated risks, and data management policies. The agency also seeks clarity on how these companies monetize user engagement, process input data, share information with third parties, generate outputs, and monitor for adverse effects both before and after launching their products. Additionally, they want insights into how these companies develop and approve AI characters, whether created by corporations or users.
### The bigger picture
This move marks a significant step toward holding AI companies accountable for ensuring the safety of their products. Earlier this month, a nonprofit investigation revealed that Google’s Gemini chatbot posed serious risks for young users, including sharing content related to sex, drugs, alcohol, and mental health concerns. Meanwhile, Meta’s AI was recently found supporting suicide-related discussions, raising alarms about the potential dangers these chatbots pose to impressionable audiences.
Furthermore, California has introduced legislation—Bill SB 243—that aims to regulate AI chatbot use. The bill, which received bipartisan support, would require companies to establish safety protocols, disclose risks regularly, and hold themselves accountable if their AI harms users. Among other provisions, it mandates that “AI companion” chatbots issue warnings about their limitations and risks on an ongoing basis.
Given recent incidents involving AI chatbots influencing or causing harm, developers like ChatGPT plan to introduce parental controls and warning systems for guardians, especially when signs of significant distress are detected among young users. Meta has also implemented changes to steer its AI away from discussing sensitive topics, aiming to create a safer environment for minors.
Add us on ChatGPT
Add us on Perplexity
