Unverified50% confidenceFactExact time
The derivation gap appears in three scenarios: the value comes from a function schema default that the user never mentioned; the value must be inferred from context; or the text containing the value is truncated outside the judge's input.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTool-calling judge models have a systematic flaw: when no source for a value can be found in the input, the judge is more inclined to reject it even if the value is completely correct, a phenomenon named the "derivation gap".65% similarUnverifiedThe benchmark scoring rules specify that any out-of-bounds violation or unparseable output results in a score of 0; otherwise, the score is the average of schema, defer, and faithful.63% similarUnverifiedIntermediate reasoning steps in Extra High reasoning mode exist as hidden tokens, which users cannot see but are still billed by the system.61% similarUnverifiedWhen a certain delta happens to be empty tool-call data, if the parsing logic handles it improperly, it may incorrectly judge that the entire reasoning stream has ended and thus lose subsequent content.61% similarUnverifiedArbitrary clustering operations may destroy core causal relationships between variables, leading to incorrect identification conclusions.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1023642API
curl https://kongchang.com/api/v1/knowledge/claims/1023642MCP
get_claim(id=1023642)