Unverified50% confidenceFactExact time
In CAFA-IVR v1.1.0, if a metric is missing, cannot be parsed as a number, parses to infinity or NaN, or the summary file is unreadable or empty, any of these cases will print FAIL, identify the offending input and exit with status code 2.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedThe pilot dataset bundled with the CAFA-IVR framework (reproduction data for 360 trials) has no key-entity annotations and reports ceer: null in the summary, so it cannot pass its own CEER gate.60% similarUnverifiedThe diff in differential testing covers only the recorded inputs, and scenarios not present in the case files (such as multi-line invoices) will not be detected.57% similarUnverifiedv2.1.281 hardened permission rule parsing: permission rules containing NUL bytes are no longer incorrectly expanded into wildcard matches and will not match anything.57% similarUnverifiedAt N=20, a single fingerprint and a single output still cannot prove determinism.56% similarUnverifiedThe 400 error body detection also checks for the keyword 'invalid', causing the system to incorrectly learn that gpt-5.6-luna lacks the reasoning_effort field and to stop sending even the necessary 'none' specification.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1069754API
curl https://kongchang.com/api/v1/knowledge/claims/1069754MCP
get_claim(id=1069754)