Unverified50% confidenceFactExact time
The decision_router plugin's default threshold is 0.8, and across all test variants not a single one of Laya's answers reached that threshold.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/15/2026
First Seen
Valid until: 1/13/2027
Sources
Related Entities
Related Claims
UnverifiedDecision-1's threshold of 0.5 is a bad default value; the threshold must be optimized on a calibration set, and the best threshold in this paper's HDFS task is 0.15.67% similarUnverifiedZero-shot Qwen2.5-VL-3B-Instruct achieved a full-invoice exact rate of 5.3% and an auto-approval rate of 8.1% on the test set; the OCR + rules baseline achieved a full-invoice exact rate of 37.8% and an auto-approval rate of 55.0%.61% similarUnverifiedQwen Next scored only 6/108 (5.56%) in testing due to format reliability issues (17 invalid_json responses, with only 6 entries scorable) rather than insufficient comprehension.60% similarUnverifiedIn a test of 48 synthesized programming requests, under the default four-option question Laya matched the team's annotation on only 21 of them, with a maximum confidence of only 0.26.60% similarUnverifiedCaveman's fixed benchmark test results from 54 runs show a 33.2% reduction in input tokens, with all 18/18 correctness checks passing.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1037627API
curl https://kongchang.com/api/v1/knowledge/claims/1037627MCP
get_claim(id=1037627)