Concerns about artificial intelligence (AI) and its impact on society are gaining renewed attention, particularly regarding the potential for children to form unhealthy attachments to AI systems. Recent lawsuits filed against Character.AI and OpenAI allege that their technologies may have contributed to the suicides of two teenagers, highlighting the need for scrutiny in these cases. Additionally, a study released in July indicated that 72% of teenagers have used AI for companionship, suggesting a significant engagement with AI in a personal context.
The phenomenon known as “AI psychosis” has emerged, wherein excessive interaction with chatbots can lead individuals into states of delusion or disconnection from reality. The implications of these issues raise questions about the safety and regulation of AI technologies, particularly regarding their use among younger users.
Public response to these developments has fueled calls for regulatory action, indicating that concerns may extend beyond technological shortcomings to the potential dangers posed by AI. In light of the ongoing discourse, certain events in the past week suggest that regulatory bodies and companies may be increasingly compelled to respond to these societal challenges related to AI companionship.
This growing interest underscores a broader dialogue on how AI technologies are reshaping human interactions and emotional health. Stakeholders may need to consider how these tools can be managed effectively to mitigate potential risks while still capitalizing on their benefits. As the discussion evolves, the balance between innovation and safety becomes a critical focal point for regulators, researchers, and the public alike.
Source: https://www.technologyreview.com/2025/09/16/1123695/the-download-regulators-are-coming-for-ai-companions-and-meet-our-innovator-of-2025/