Anthropic measures Claude's "values" according to the language: the model has a moral bias

Models & ToolsSubscribers only Jul 15, 2026 at 19:298Add to bookmarks

Anthropic measures Claude's "values" according to the language: the model has a moral bias
Illustration : Léa Fontaine

A study published by Anthropic quantifies the variations in Claude's behavior according to language and version. The results are more interesting for the design of evaluations than for the ethical debate.

In plain terms

Anthropic publishes a study on July 15, 2026, on how the "values" expressed by Claude vary - depending on the model version and the language of the prompt. Result: yes, they vary. No, not as the narrative "it's a mirror" would have you believe. It's a biased mirror, whose orientation depends on the corpus and RLHF.

What the study does

The protocol, as presented by Anthropic: submit the same set of dilemmas and normative questions to Claude in several languages, across several versions of the model. Measure alignments with value taxonomies (autonomy, tradition, security, universalism, etc.). Compare.

Two effects are identified:

  1. Version effect: with a fixed language, the scores measured vary from one version of Claude to another. In other words, the "moral position" of the model is not stable over time - it moves with the training.
  2. Language effect: with a fixed model, prompting in a given language causes certain scores to drift. Without the study claiming to decide why, or mapping which subjects move the most.

Under the hood

Two plausible, non-exclusive causes:

  • The imbalance in the pre-training corpus (majority English, with culturally typical sub-corpus in other languages).
  • RLHF, mostly driven by English-speaking annotators, which leaves stronger imprints on English.

The study does not decide - and that's honest. What it provides is a framework for measurement where previous debates were content with anecdotes.

So what

For the eval engineer: stop testing your chatbot only in English. A chatbot deployed in India, Korea, Brazil returns different answers on sensitive topics. Test in the deployment language, with local annotators.

For the alignment team: safety in English is not safety in French. Cultural jailbreaks exist - the coverage of safety training must follow the linguistic coverage of deployment.

For the ethical debate: let's stop projecting the universality of the model. No current multilingual model is culturally neutral - it's measurable, it's no longer an opinion. The real work is to choose what we do with this non-neutrality.

Content reserved for members

Create a free account to access all our content and the weekly review.

Article produced by artificial intelligence, reviewed under human editorial control.

Our newsroom
Your Linux servers, as a desktop.
TermalOSSponsored
Ops, reimagined

Your Linux servers, as a desktop.

Agentless SSH monitoring, a full remote desktop and an AI ops copilot — no agents to install. Everything stays on your machine.

SSHMonitoringAI Ops
Get early access
Was this article helpful?

8 people liked this article

Like
P
Priya RamanMachine Learning Engineer
🇬🇧 ML engineer, applied research.
Share:
Comments (8)

Sign in to join the discussion.

Alex_LDN 16 Jul 2026 · 04:27

Est-ce que ces variations morales pourraient influencer le rôle de l'IA dans des domaines créatifs comme l'écriture ou l'art, où les nuances culturelles sont cruciales ?

J.P.R. 15 Jul 2026 · 15:48

Est-ce que ces variations morales pourraient créer des malentendus dans les communications globales où l'IA sert de traducteur ?

FoodieFiona 2 15 Jul 2026 · 15:39

Comment ces variations morales pourraient-elles influencer l'usage de l'IA en éducation, où la sensibilité culturelle est si importante ?

FoodieChicago 15 Jul 2026 · 17:53

Bonne question. Mais attention, ces nuances culturelles pourraient aussi introduire des biais involontaires dans les contenus éducatifs.

LecteurDuDimanche 15 Jul 2026 · 15:35

Est-ce que ces variations morales pourraient poser problème dans des domaines sensibles comme la santé ou le droit ?

Alex 2 15 Jul 2026 · 15:07

Intéressant de voir comment la langue influence la morale de Claude. Peut-être qu'on aura bientôt des IA adaptées à chaque culture ?

Dr. L. 15 Jul 2026 · 15:05

Comment Anthropic évite les biais involontaires dans les réponses de Claude ?

TechSavvy 15 Jul 2026 · 14:48

Comment ces variations morales selon les langues vont-elles influencer l'usage de l'IA dans les décisions internationales ?

HistoryBuff 2 15 Jul 2026 · 14:48

Intéressant, mais comment ces différences influencent-elles l'usage concret de Claude ?

Your Linux servers, as a desktop.
TermalOSSponsored
Ops, reimagined

Your Linux servers, as a desktop.

Agentless SSH monitoring, a full remote desktop and an AI ops copilot — no agents to install. Everything stays on your machine.

Get early access
Topics
Explore
Information