[KongchangAI]
Conceptmodule coverage

Module Coverage

A measure of the contextual diversity with which each module appears in the training set; it is another key evaluation property affecting compositional generalization performance.

Timeline (last 90 days)

Nov 11

Module coverage measures the diversity of contexts in which each module appears in the training set.

Unverified50%
Nov 11

Although step-by-step models train intermediate outputs and provide denser supervision signals, they still cannot fully offset the negative effects of module coverage shift.

Unverified50%
Nov 11

If a benchmark contains both module coverage violations and compositional equivalence, shortcut learning is exacerbated.

Unverified50%
Nov 11

Compositional generalization benchmark design should avoid test sets that contain compositional equivalence, control module coverage shift, and consider both factors simultaneously.

Unverified50%
Nov 11

Evaluating compositional generalization is not merely a training-test split problem; ignoring compositional equivalence and module coverage may lead to erroneous judgments about model capabilities.

Unverified50%

All Facts (5)

Source Articles