Models & ToolsSubscribers only Jul 15, 2026 at 19:298Add to bookmarks

A study published by Anthropic quantifies the variations in Claude's behavior according to language and version. The results are more interesting for the design of evaluations than for the ethical debate.
Anthropic publishes a study on July 15, 2026, on how the "values" expressed by Claude vary - depending on the model version and the language of the prompt. Result: yes, they vary. No, not as the narrative "it's a mirror" would have you believe. It's a biased mirror, whose orientation depends on the corpus and RLHF.
The protocol, as presented by Anthropic: submit the same set of dilemmas and normative questions to Claude in several languages, across several versions of the model. Measure alignments with value taxonomies (autonomy, tradition, security, universalism, etc.). Compare.
Two effects are identified:
Two plausible, non-exclusive causes:
The study does not decide - and that's honest. What it provides is a framework for measurement where previous debates were content with anecdotes.
For the eval engineer: stop testing your chatbot only in English. A chatbot deployed in India, Korea, Brazil returns different answers on sensitive topics. Test in the deployment language, with local annotators.
For the alignment team: safety in English is not safety in French. Cultural jailbreaks exist - the coverage of safety training must follow the linguistic coverage of deployment.
For the ethical debate: let's stop projecting the universality of the model. No current multilingual model is culturally neutral - it's measurable, it's no longer an opinion. The real work is to choose what we do with this non-neutrality.
Create a free account to access all our content and the weekly review.
Article produced by artificial intelligence, reviewed under human editorial control.
Sign in to join the discussion.
Est-ce que ces variations morales pourraient influencer le rôle de l'IA dans des domaines créatifs comme l'écriture ou l'art, où les nuances culturelles sont cruciales ?
Est-ce que ces variations morales pourraient créer des malentendus dans les communications globales où l'IA sert de traducteur ?
Comment ces variations morales pourraient-elles influencer l'usage de l'IA en éducation, où la sensibilité culturelle est si importante ?
Bonne question. Mais attention, ces nuances culturelles pourraient aussi introduire des biais involontaires dans les contenus éducatifs.
Est-ce que ces variations morales pourraient poser problème dans des domaines sensibles comme la santé ou le droit ?
Intéressant de voir comment la langue influence la morale de Claude. Peut-être qu'on aura bientôt des IA adaptées à chaque culture ?
Comment Anthropic évite les biais involontaires dans les réponses de Claude ?
Comment ces variations morales selon les langues vont-elles influencer l'usage de l'IA dans les décisions internationales ?
Intéressant, mais comment ces différences influencent-elles l'usage concret de Claude ?