OpenAI, Google, Microsoft among 13 AI companies told to fix ‘harmful’ AI behaviour or face action
Posted on: Dec 11, 2025 22:41 IST | Posted by: Livemint
OpenAI, Google, Microsoft ar among 13 top out unreal intelligence service companies feature been given a warning over "delusional outputs" from their chatbots by a group of bipartisan state attorney generals. In a letter made public on Wednesday, dozens of state Attorney genrals expressed serious concerns about the rise of ‘sycophantic and delusional’ outputs from AI chatbots.
The AGs have also warned the tech giants to add additional safeguards to protect children from the sycophantic and delusional outputs from their AI chatbots by 16 January, 2026. They also warn that support for innovations is not “an excuse for noncompliance with our laws, misinforming parents, and endangering our residents, particularly children.”
They references several media reports about AI chatbots going haywire including cases where the AI helped teens plan their own suicide or encouraged their delusions. The AGs also cited reports of chatbots inducing "AI psychosis," where the AI amplifies a user's paranoia or delusions.
"GenAI products generated sycophantic and delusional outputs that either encouraged users’ delusions or assured users that they were not delusional." the AGs noted
In the letter, the AGs also noted that some of the conversatoions by these chatbots could be going against some of the state laws like encouraging illegal activity or practicing medicine without a license.
They also warn about the ‘dark patterns’ with the AI chatbots which includes anthropomorphization, harmful content generation, and manipulating users to increase retention.
"Many of our states have robust criminal codes that may prohibit some of these conversations that GenAI is currently having with users, for which developers may be held accountable for the outputs of their GenAI products" they further added
What are AGs demanding?
The AGs are demanding that the AI companies must outline the specific guardrails they have implemented or plan to implement to cut out the concerning sycophantic and delusional behaviour form their chatbots.
The letter also warns the tech giants to implement a ‘clear and conspicuous warning’ that is ‘permanently viewable on the same screen’ concerning the potentially harmful outputs that may be generated by the generative AI chatbot.
The letter by the AGs is addressed to 13 AI companies which inclues Anthropic, Apple, Chai AI, Character Technologies, Google, Luka, Meta, Microsoft, Nomi AI, OpenAI, Perplexity AI, Replika, and xAI
Global News Perspectives
In today's interconnected world, staying informed about global events is more important than ever. ZisNews provides news coverage from multiple countries, allowing you to compare how different regions report on the same stories. This unique approach helps you gain a broader and more balanced understanding of international affairs. Whether it's politics, business, technology, or cultural trends, ZisNews ensures that you get a well-rounded perspective rather than a one-sided view. Expand your knowledge and see how global narratives unfold from different angles.
Customizable News Feed
At ZisNews, we understand that not every news story interests everyone. That's why we offer a customizable news feed, allowing you to control what you see. By adding keywords, you can filter out unwanted news, blocking articles that contain specific words in their titles or descriptions. This feature enables you to create a personalized experience where you only receive content that aligns with your interests. Register today to take full advantage of this functionality and enjoy a distraction-free news feed.
Like or Comment on News
Stay engaged with the news by interacting with stories that matter to you. Like or dislike articles based on your opinion, and share your thoughts in the comments section. Join discussions, see what others are saying, and be a part of an informed community that values meaningful conversations.
Download the Android App
For a seamless news experience, download the ZisNews Android app. Get instant notifications based on your selected categories and stay updated on breaking news. The app also allows you to block unwanted news, ensuring that you only receive content that aligns with your preferences. Stay connected anytime, anywhere.
Diverse News Categories
With ZisNews, you can explore a wide range of topics, ensuring that you never miss important developments. From Technology and Science to Sports, Politics, and Entertainment, we bring you the latest updates from the world's most trusted sources. Whether you are interested in groundbreaking scientific discoveries, tech innovations, or major sports events, our platform keeps you updated in real-time. Our carefully curated news selection helps you stay ahead, providing accurate and relevant stories tailored to diverse interests.
No comments yet.