[KongchangAI]
Unverified50% confidenceFactExact time

Contamination detection is performed on each instruction set using two checks: the problem text is normalized by taking the first 80 characters of the HumanEval docstring and compared; the reference answer, after removing comments and docstrings, is checked for whether more than half of the 13-token n-grams match.

1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1013056
API
curl https://kongchang.com/api/v1/knowledge/claims/1013056
MCP
get_claim(id=1013056)