Unverified50% confidenceSolutionExact time
Looking at the label count per category can serve as a zero-cost diagnostic for detecting scorer class collapse: if the compliant category count is abnormally low or even zero while adjacent categories are abnormally inflated, it indicates the scorer may be collapsing.
1
Sources
50%
Confidence
Long-term
Relevance
10/20/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFor categorical policies, as the output distribution becomes increasingly sharp, the expected score-gradient norm approaches zero, resulting in the weakest updates for tokens that are confident but incorrect.69% similarUnverifiedThe core of evaluation is scoring, typically expressing the quality of results using a continuous value from 0 to 1.68% similarUnverifiedIn few-shot scenarios (e.g., approximately 20 samples per class), multi-class subdivision should be abandoned, all defects should be collapsed into a binary classification problem (defective/non-defective), and specific classification should be left to manual post-processing.68% similarUnverifiedThe quality ceiling of weak supervision labels depends on the accuracy of the zero-shot model itself; if the model makes systematic errors, the training set will inherit that bias.67% similarUnverifiedThe two hard zeros for graph retrieval in the benchmark were because the grader required exact wording while the model paraphrased; the README documents every point lost.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1074738API
curl https://kongchang.com/api/v1/knowledge/claims/1074738MCP
get_claim(id=1074738)