BenchmarkRisk-Coverage AUC

Risk-Coverage Area

A metric for evaluating the performance of abstention strategies. It computes the area under the risk-coverage curve, reflecting the model's error-rate behavior across different abstention proportions.

Timeline (last 90 days)

Nov 6

In most cells where accuracy rises, the risk-coverage area decreases.

Unverified50%

Nov 6

When the number of candidates increases to eighteen, confidence errors in the term and slang scenarios rise somewhat.

Unverified50%

All Facts (2)

Unverified

In most cells where accuracy rises, the risk-coverage area decreases.

50%Unverified

When the number of candidates increases to eighteen, confidence errors in the term and slang scenarios rise somewhat.

50%

Source Articles

Label-Wording Augmentation: Effective for Unfamiliar Words, Ineffective for Abbreviations and CodeNov 6 Low-Cost Abstention Strategy: How LLM Ticket Classification Reduces Misrouting CostsOct 23