Conceptguidance calibration
Guidance Calibration
An evaluation dimension assessing whether a model's guidance suggestions in AI mental health support are appropriate, timely, and individualized. It is a major shortcoming of current frontier models.
Timeline (last 90 days)
Oct 16
In the MindEval2 evaluation, frontier models have already clearly improved on surface quality and boundary issues, but guidance calibration is the most dominant failure mode across all models, accounting for most of the quality gap.
Unverified50%