Benchmark
FactCC
An evaluation benchmark for the factual consistency of summaries, which uses a natural language inference model to determine whether summary statements are supported by the source text.
Timeline (last 90 days)
Oct 23
Common automatic evaluation metrics include entailment scores based on NLI models, triple matching based on entity and relation extraction, and benchmarks such as FactCC and SummaC.
Unverified50%