[KongchangAI]
Conceptjoint accuracy

Joint Accuracy

A multilingual reasoning evaluation metric requiring that a model's answer be both correct and given in the target language. It penalizes language errors and answer errors jointly, preventing models from inflating accuracy by switching languages.

Timeline (last 90 days)

Nov 4

Only one intervention slightly improved joint accuracy (the answer being correct and in the target language), by just 1.60 points.

Unverified50%
Nov 4

Joint accuracy refers to the proportion of responses where the model's answer is both correct and given in the target language, penalizing both language errors and answer errors at once, and thus more faithfully reflecting multilingual reasoning ability.

Unverified50%

All Facts (2)

Source Articles