Unverified60% confidenceFactExact time
The core idea of BLEU is to compute n-gram overlap between machine translations and reference translations; its limitations include insensitivity to word order changes, inability to capture semantically equivalent synonym substitutions, and dependence on the quality and quantity of reference translations.
2
Sources
60%
Confidence
Long-term
Relevance
7/15/2026
First Seen
Sources
Related Claims
VerifiedBLEU is a natural language generation evaluation metric proposed in the 1990s that measures quality by calculating the n-gram overlap between generated text and reference translations, and remains the standard benchmark in the field of machine translation.74% similarUnverifiedAutomatic metrics such as BLEU and ROUGE require the existence of a high-quality reference translation, and many real-world scenarios do not have this condition.72% similarVerifiedBLEU is commonly used for machine translation evaluation, and ROUGE is widely applied to summarization tasks; both measure text quality by statistically calculating n-gram overlap71% similarUnverifiedchrF++ is an evaluation metric based on character-level n-grams that is more robust than BLEU when handling morphologically rich languages.68% similarUnverifiedBits per byte (bpb) is a measure of a language model's compression efficiency: the model's negative log-likelihood on text divided by the number of original bytes; since the byte sequence after detokenization is the same length for all tokenizers, bpb does not vary with how tokens are split, making it suitable for cross-vocabulary comparison.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/510735API
curl https://kongchang.com/api/v1/knowledge/claims/510735MCP
get_claim(id=510735)