Anthropic reportedly bans persistent abuse of Claude and other AI models

Anthropic has revised its usage policy to prohibit persistent and unnecessary insults or cruelty directed at its AI models, including Claude, according to an ANP/AFP report carried by Nieuws.nl [1].

The policy does not explicitly refer to “model welfare”, the report says. Anthropic chief executive Dario Amodei told The New York Times in February that he was unsure whether AI models could be conscious, but that the company was open to the possibility, according to ANP/AFP.

The company had previously announced that Claude would be able to end conversations in rare, extreme cases of persistent harmful or abusive interactions, the agencies reported. That measure was described as an option for Claude; the newly reported policy change addresses users’ behaviour towards Anthropic’s models.