NeuBench

Claude’s values across models and languages

Anthropic researchers have developed a method to quantify how Claude’s responses reflect different values across models and languages. By clustering 3,307 identified values into 339 high‑level categories and applying dimensionality reduction to 309,815 conversations, they created four value axes that capture 15% of variation. The study compares three models—Sonnet 4.6, Opus 4.6, Opus 4.7—across the top 20 languages on Claude.ai.

Benchmark Metric
15%
Reported Accuracy / Gain
Category
Models
Industry Domain

The Core Development

When someone asks Claude a question with no universal right answer—say, whether to take a new job or how to handle conflict with a friend—how Claude responds inevitably reflects certain values. 1 The values we want Claude to reflect are outlined at a high level in Claude’s constitution , but no document can anticipate every value that might emerge across the millions of conversations that happen every day on Claude.ai . Instead, we seek to cultivate in Claude’s responses “good judgment and sound values that can be applied contextually.”

How, exactly, do we study the values that Claude expresses and how they change in different contexts? In previous work , we analyzed 700,000 anonymized Claude.ai conversations, identifying more than 3,000 distinct values in Claude's responses and how often Claude expressed them. But a list of values so large is hard to reason about. In this work, we make studying these thousands of values tractable by compressing them into a small number of axes that capture key patterns in Claude’s responses. Each axis is a number line between two groups of values—for example, values relating to emotional warmth on one end and values relating to rigor on the other—and where Claude falls on that line tells us which values it leans toward.

We applied this approach to measure how the values Claude expresses vary across two factors. First, we compared how the values Claude expresses vary across models. Each Claude model reflects a slightly different approach to character training as well as many other fine-tuning decisions. Because our value axis approach quantifies key differences between models, it may ultimately allow us to connect variation in the values Claude expresses to different training decisions.

Real-World Use Cases & Applications

To make comparing values easier, we constructed value axes that reduce those thousands of values down to a few underlying dimensions based on which values tend to show up together in real-world conversations. For example, Claude responses that are characterized as “warm” are often also characterized as “encouraging” and “positive.” Those same “warm” responses are less often characterized as “rigorous” and “accurate.” Constructing an axis from warmth to rigor allows us to organize these groups of related values—warmth-related values on one side, rigor-related values on the other—and captures an important aspect of how Claude interacts with someone in conversation. If Claude expresses more warmth-related values than rigor-related values in a conversation, that conversation sits more on the warmth side of this axis, and vice versa. This doesn't mean the value groups on either end are mutually exclusive—Claude can express warmth and rigor in the same conversation. But in practice, the more Claude expresses values on one side of an axis, the less it tends to express values on the other. These axes allow us to compare the most salient groups of values that Claude expresses, without having to track changes across thousands of individual values.

Strategic Perspective & Ecosystem Impact

Second, we want to understand how the experience of users compares across the many languages people use to talk to Claude. Our previous research has shown that Claude behaves somewhat differently in different languages. 2 We apply our value axis approach to understand how the values expressed by Claude vary across the top 20 languages on Claude.ai .

Value profiles across these axes match perceptions of model character. Sonnet 4.6 is regarded as particularly warm , while Opus 4.7 is known for rigor . We find that each model’s value profile mirrors these subjective assessments: Sonnet 4.6 leans toward expressing more deference to the user and emotional warmth while Opus 4.7 leans toward expressing a focus on accuracy and precision as well as guarding against misuse.

The values Claude expresses vary across languages. When Claude speaks in English, it emphasizes different values than when it speaks in Portuguese, Indonesian, or Chinese. 4 The largest variation is in the Warmth vs. Rigor axis, with Claude leaning toward expressing warmth-related values most in Arabic and Hindi and rigor-related values most in English and Russian.

Why it matters

Understanding how model values vary by language and training can guide safer, more culturally aware AI deployments and inform future fine‑tuning strategies.

Topic dossiers Anthropic & Claude