Unverified50% confidenceFactExact time
In Helio's scoring framework, refusing to answer is set as an explicit scoring category with the same weight as a correct answer, which changes the objective of prompt optimization.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedThe abstention scoring mechanism is designed as follows: a correct answer earns a positive score, a wrong answer earns a negative score, and abstaining earns zero or a small negative score.71% similarUnverifiedUsing an external dedicated answer selector for abstention decisions may be more practical and controllable than directly fine-tuning a model to internalize abstention.69% similarUnverifiedIf the judge systematically favors values that are "documented" and rejects correct values that "require reasoning," then correct parameters that require complex reasoning to derive may be incorrectly marked as failures in evaluation.66% similarUnverifiedDecision Brain's answer verification requires that every cited [id] must have actually been returned by the tools in this round, every number must appear in the evidence of the cited item, and "I don't know" counts as a valid abstention only when the rest of the answer contains no assertions.65% similarUnverifiedMethods for obtaining honest feedback from AI include asking neutral questions without revealing one's expected inclination, and giving it a rubric to force it to remain objective.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1063216API
curl https://kongchang.com/api/v1/knowledge/claims/1063216MCP
get_claim(id=1063216)