Unverified50% confidenceFactExact time
A 56.6% fidelity pass rate means that more than 40% of test scenarios still show behavioral deviations, including inconsistencies in response structures, error codes, and boundary conditions.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
11/12/2026
First Seen
Valid until: 11/26/2026
Sources
Related Entities
Related Claims
UnverifiedOn a benchmark of 23 test scenarios and two tools, the strategy of "intercept on any change to the full set" had a false positive rate of 50%.77% similarUnverifiedOn Track B, the flat RAG baseline can detect 76%–97% of true contradictions, but produces false positives on 16%–43% of surface-similar safe drafts (the specific ratio depends on the backend).76% similarUnverifiedThe separately tested version with the auxiliary danger head reached 99.7% recall but still missed a rare straight-line configuration, resulting in a confident collision.75% similarUnverifiedIn single-environment tests with 25 benign tasks and three frameworks, the probabilistic gate reduced completion rate to 56%, hard-blocked 4% of legitimate calls, and diverted 12–16% of legitimate calls into a delay queue, while no gate, the rule gate, and the LLM review gate all had completion rates of 68–72%.75% similarUnverifiedIn a test of 119 pairs of "near-identical questions", at the 0.81 threshold 62% of modified questions incorrectly hit; even raised to 0.90, 25% still hit; the hit rate for genuine synonymous rewrites dropped from 39% to 4%.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1163846API
curl https://kongchang.com/api/v1/knowledge/claims/1163846MCP
get_claim(id=1163846)