ConceptCharacter N-gram Overlap
Character N-gram Overlap
A coarse but effective method of text fingerprint comparison that computes the character-level n-gram overlap rate to detect changes in model output style. It is used for model drift monitoring.
Timeline (last 90 days)
Oct 18
Cheap metrics that can be used to detect model drift include self-consistency, output length distribution, character n-gram overlap (Jaccard similarity), error rate, and refusal rate.
Unverified50%