Process Hallucination
A failure mode in which a dialogue agent deviates from the dialogue flow it should follow, even though each individual utterance is fluent, reasonable, and factually correct. It stands in contrast to factual hallucination.
Timeline (last 90 days)
The IDIAP research team proposed DialFork, the first process hallucination evaluation benchmark for raw dialogue text.
Process hallucination refers to a failure mode in which the model's individual sentences are fluent, reasonable, and factually correct, but deviate from the dialogue flow it should have followed.
Optimizing single-sentence quality cannot solve process hallucination; a model may perform excellently at every local point yet be unreliable overall, and evaluation must explicitly incorporate the process dimension.
All Facts (3)
Process hallucination refers to a failure mode in which the model's individual sentences are fluent, reasonable, and factually correct, but deviate from the dialogue flow it should have followed.
50%UnverifiedOptimizing single-sentence quality cannot solve process hallucination; a model may perform excellently at every local point yet be unreliable overall, and evaluation must explicitly incorporate the process dimension.
50%UnverifiedThe IDIAP research team proposed DialFork, the first process hallucination evaluation benchmark for raw dialogue text.
50%