Cross-Model Fit
An evaluation metric measuring a framework's overall applicability across all evaluated models, reflecting the framework's generality.
Timeline (last 90 days)
The researchers developed an evaluation framework comprising five complementary metrics: VCR, Model-Harness Fit, Cross-Model Fit, Interaction Residuals and Token Load.
Model-Harness Fit measures, for a given model, the extent to which a harness supports task achievement through valid completion; Cross-Model Fit measures a harness's overall applicability across all evaluated models.
All Facts (2)
The researchers developed an evaluation framework comprising five complementary metrics: VCR, Model-Harness Fit, Cross-Model Fit, Interaction Residuals and Token Load.
50%UnverifiedModel-Harness Fit measures, for a given model, the extent to which a harness supports task achievement through valid completion; Cross-Model Fit measures a harness's overall applicability across all evaluated models.
50%