Anthropic gives Claude AI power to end conversations as part of 'model welfare' push
Posted on: Aug 17, 2025 07:11 IST | Posted by: Livemint
In the fasting moving domain of unreal intelligence service thither is almost some new feature or model being launched every single day but one feature that no one saw coming is from Anthropic, the maker of popular AI chatbot Claude. The AI startup is now providing some of its AI models the ability to end conversations on Claude as part of its exploratory work on ‘model welfare’.
“This is an experimental feature, intended only for use by Claude as a last resort in extreme cases of persistently harmful and abusive conversations.” the company states
Anthropic says that a vast majority of users will never experience Claude ending a conversation on its own.
Moreover, the company adds that Claude's conversation ending ability is a last resort when multiple attempts at redirection hae failed and “hope of a productive interaction has been exhausted, or when a user explicitly asks Claude to end a chat”.
“The scenarios where this will occur are extreme edge cases—the vast majority of users will not notice or be affected by this feature in any normal product use, even when discussing highly controversial issues with Claude.” Anthropic adds
Why is Anthropic adding conversation ending ability to Claude?
Anthropic says that the moral status of Claude or other large language models (LLMs) remains highly uncertain, meaning that there is no clarity yet on whether these AI systems could ever feel anything like pain, distress or well being.
However, the AI startup is taking this possibility seriously and believes its important to investigate it seriously. In the meantime, the company is also looking at “low cost intervenetions” which dont cost much could potentially reduce harm to AI systems and allowing the LLM to end the conversation is one such method.
Anthropic says that that it tested Claude Opus 4 before its release and part of that testing was a “model welfare assessment,”. The company found that Claude consistently rejected requested where there there was possibility of harm. For example the model
When users kept pushing for dangerous or abusive content even after refusals, the AI model’s responses started looking stressed or uncomfortable. Some of these requests where Claude showed signs of ‘distress’ were about generating sexual content around minors or attempts to solicit information that would enable large scale violence or acts of terror.
Global News Perspectives
In today's interconnected world, staying informed about global events is more important than ever. ZisNews provides news coverage from multiple countries, allowing you to compare how different regions report on the same stories. This unique approach helps you gain a broader and more balanced understanding of international affairs. Whether it's politics, business, technology, or cultural trends, ZisNews ensures that you get a well-rounded perspective rather than a one-sided view. Expand your knowledge and see how global narratives unfold from different angles.
Customizable News Feed
At ZisNews, we understand that not every news story interests everyone. That's why we offer a customizable news feed, allowing you to control what you see. By adding keywords, you can filter out unwanted news, blocking articles that contain specific words in their titles or descriptions. This feature enables you to create a personalized experience where you only receive content that aligns with your interests. Register today to take full advantage of this functionality and enjoy a distraction-free news feed.
Like or Comment on News
Stay engaged with the news by interacting with stories that matter to you. Like or dislike articles based on your opinion, and share your thoughts in the comments section. Join discussions, see what others are saying, and be a part of an informed community that values meaningful conversations.
Download the Android App
For a seamless news experience, download the ZisNews Android app. Get instant notifications based on your selected categories and stay updated on breaking news. The app also allows you to block unwanted news, ensuring that you only receive content that aligns with your preferences. Stay connected anytime, anywhere.
Diverse News Categories
With ZisNews, you can explore a wide range of topics, ensuring that you never miss important developments. From Technology and Science to Sports, Politics, and Entertainment, we bring you the latest updates from the world's most trusted sources. Whether you are interested in groundbreaking scientific discoveries, tech innovations, or major sports events, our platform keeps you updated in real-time. Our carefully curated news selection helps you stay ahead, providing accurate and relevant stories tailored to diverse interests.
No comments yet.