Hallucination Rate
A core metric for measuring the reliability of large language models, referring to the proportion of responses in which the model fabricates information that appears plausible but is untrue. A lower hallucination rate indicates that the model is more inclined to acknowledge uncertainty rather than force a fabrication.
Timeline (last 90 days)
The paper gives a lower bound: after pretraining, the hallucination rate is at least equal to the proportion of facts in the training set that appear only once.
Hallucination rate is a metric measuring a model's tendency to fabricate content when it does not know the answer, and it must be understood separately from the knowledge score.
A low hallucination rate reduces risk but cannot replace manual verification against the original text.
All Facts (4)
通过RAG加载外部知识库可以同时降低幻觉率和空答率，但在外部知识固定的情况下两者呈此消彼长的关系
80%UnverifiedThe paper gives a lower bound: after pretraining, the hallucination rate is at least equal to the proportion of facts in the training set that appear only once.
50%UnverifiedHallucination rate is a metric measuring a model's tendency to fabricate content when it does not know the answer, and it must be understood separately from the knowledge score.
50%UnverifiedA low hallucination rate reduces risk but cannot replace manual verification against the original text.
50%