Unverified50% confidenceTradeoffExact time
The small verifier (3B) is a lossy acceleration mode whose scoring criterion is not fully consistent with the proposer, potentially causing output distribution shift and accuracy degradation.
1
Sources
50%
Confidence
Long-term
Relevance
10/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe breaking points of automated evaluation include: LLM evaluators are lenient, judge partially correct answers poorly, are sensitive to prompt wording, miss small errors, and their agreement rates can mask low recall.73% similarUnverifiedThe claim that deterministic mode is 2–3× slower does not hold up in empirical testing and likely originates from certain particularly unlucky operators or older software stacks.73% similarUnverifiedThe convergence rate bounds depend jointly on the spectral properties of the measurement error, the latent exposure, and the target functional71% similarUnverifiedSPLIT's formula explains a counterintuitive phenomenon: under certain conditions, adding more LLM judges actually reduces accuracy, because verifier errors are correlated, and calling the same or similar verifiers multiple times cannot independently eliminate errors and may instead amplify systematic bias.71% similarUnverified天花板效应指当测试工具的难度上限低于被测对象的实际能力时,分数分布呈现严重负偏态,导致测试的信度和效度显著下降70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1079147API
curl https://kongchang.com/api/v1/knowledge/claims/1079147MCP
get_claim(id=1079147)