Unverified50% confidenceConceptExact time
The robust policy fidelity metric is measured by family-level pass rate, so a score of 50% means half of the families passed all checks, not that half of the individual answers were correct.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe gap between selection and generation exceeds 50 percentage points, revealing that reliability is far lower than benchmarks suggest when users need the model to directly write out kinship terms.65% similarUnverifiedSelf-Consistency通过多次采样推理路径后投票取多数答案，可进一步提升准确率约5-10个百分点65% similarUnverifiedAccording to the properties of the binomial distribution, detecting a 5% failure rate with 95% confidence requires at least approximately 60 independent runs.63% similarUnverified研究表明人类评估者在判断LLM输出的事实准确性时，正确率往往只有50%-70%62% similarUnverifiedOn the cluster panel, replacing the model's structured decision-making with code (based on the same extracted facts) improved family accuracy by an average of 20.5 percentage points, with Llama 3.1 8B rising from 1% under self-judgment to 56% under code adjudication.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1003872API
curl https://kongchang.com/api/v1/knowledge/claims/1003872MCP
get_claim(id=1003872)