Reconstruction Fidelity
A metric measuring how well a compressed representation restores the semantic content of the original input. It is commonly evaluated using perplexity, token-level accuracy, or cosine similarity, and is orthogonal to behavioral fidelity.
Timeline (last 90 days)
Reconstruction fidelity is usually measured by perplexity, token-level accuracy, or cosine similarity, reflecting whether the compressed representation can restore the semantic content of the original input.
Reconstruction fidelity and behavioral fidelity are two orthogonal dimensions and need to be measured separately.
When evaluating compression quality, looking only at reconstruction fidelity is insufficient; behavioral metrics such as the refusal rate need to be additionally evaluated.
All Facts (3)
Reconstruction fidelity is usually measured by perplexity, token-level accuracy, or cosine similarity, reflecting whether the compressed representation can restore the semantic content of the original input.
50%UnverifiedReconstruction fidelity and behavioral fidelity are two orthogonal dimensions and need to be measured separately.
50%UnverifiedWhen evaluating compression quality, looking only at reconstruction fidelity is insufficient; behavioral metrics such as the refusal rate need to be additionally evaluated.
50%