External Proxy Indicator
In measurement theory, a substitute variable that is related to the target construct but easier to observe or more objective. In this research it is used to verify whether automatically generated codebooks genuinely measure discourse quality, by testing the direction of correlation between automated coding scores and external variables, supplemented by cross-validation with human annotations, thereby providing a validity safeguard for large-scale automated assessment.
Timeline (last 90 days)
The study designed two evaluation paths: external proxy indicators and inter-model agreement (IMA).
External proxy indicators are substitute variables that are related to the target construct but easier to observe or more objective; in this study they were used to test the expected directional correlation between automated codebook ratings and external variables, supplemented by cross-validation with human annotations.
All Facts (2)
The study designed two evaluation paths: external proxy indicators and inter-model agreement (IMA).
50%UnverifiedExternal proxy indicators are substitute variables that are related to the target construct but easier to observe or more objective; in this study they were used to test the expected directional correlation between automated codebook ratings and external variables, supplemented by cross-validation with human annotations.
50%