Unverified50% confidenceFactExact time
Jev's average confidence was 0.979 on clear tickets and dropped to 0.841 on six ambiguous tickets; the direction of the gap is right but the magnitude is small, possibly insufficient to support reliable threshold routing.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/19/2026
First Seen
Valid until: 11/2/2026
Sources
Related Entities
Related Claims
UnverifiedIn zero-shot quality, Jev is the reference benchmark; Drex's vendor reports that on its Decision Index it leads Jev 61.25 to 57.96, but on JevBench it is slightly lower at 85.7% versus Jev's 86.6%; Laya's zero-shot on typed-decisions is only 0.362, below the 0.461 majority-class baseline.72% similarUnverifiedAt the 0.81 threshold, the proportion of cached answers that "fit the question" is 5.8 to 10.7 percentage points lower than fresh answers; converted to all responses, the overall quality loss is about 2 to 3 percentage points; Haiku 5.5 has the largest gap (10.7 percentage points), with a cached-answer pass rate of only 67.9%.71% similarUnverifiedIn offline MiniBooNE experiments, JevForest achieved an accuracy of 0.845±0.010 using ten features, improving to 0.885±0.008 using forty features.71% similarUnverifiedIn the first round of 34 logical reasoning questions, a single-head model similar to JEV achieved an accuracy of 94.12%, while GAN8 achieved 93.01%, nearly tied.71% similarUnverifiedWhen Jev returns a confidence level above 0.95 (approximately 60% of messages), accuracy reaches 95.8%, indicating reliable confidence calibration quality70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1067291API
curl https://kongchang.com/api/v1/knowledge/claims/1067291MCP
get_claim(id=1067291)