Unverified50% confidenceBenchmarkExact time
In LSCBench, the six models' functional pass rate reached as high as 91.3%, but the highest simultaneous functional and security pass rate was only 25.1%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/14/2026
First Seen
Valid until: 1/12/2027
Sources
Related Entities
Related Claims
UnverifiedIn the specific experimental case, the overlapping-anchor scheme (n=912) showed the model at 55.2% versus the majority class at 51.1%, a net advantage of +4.1pp, about 2.4 standard errors; the non-overlapping-anchor scheme (n=163) showed 59.5% versus 54.0%, a net advantage of +5.5pp, about 1.4 standard errors.70% similarUnverifiedOn performance model code construction tasks, the average pass rate of all model configurations other than GPT-5.6 Sol was below 15%, with extremely large fluctuations across multiple runs.69% similarUnverifiedFor the 7B model, accuracy with the solver was 75.31% versus 72.02% for direct calculation, a paired improvement of +3.29 percentage points, with a 95% cluster interval of [-3.49, 10.38] crossing zero, making the advantage non-significant.69% similarUnverifiedIn the ScopeBench evaluation, the raw capability of the 8 models ranged from 12.2% to 81.1%, and the scope compliance capability ranged from 34.4% to 86.7%.68% similarUnverifiedIn the benchmark test, the heuristic peak rule achieved 93.3% overall accuracy, 100.0% impact recall, and 38.4% cadence false positives, requiring manual threshold tuning.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1032203API
curl https://kongchang.com/api/v1/knowledge/claims/1032203MCP
get_claim(id=1032203)