[KongchangAI]
ConceptOracle覆盖率 / answer coverage / oracle coverage

LLM Harness Coverage

A metric for measuring the performance of a set of LLM harnesses, defined as the proportion of problems for which at least one program in the set produces a correct answer. As an upper-bound metric, it is susceptible to misattributing repeated random successes from multiple executions as evidence of genuine specialization.

Source Articles