Unverified50% confidenceFactExact time
FINAL-Bench is the framework and competition infrastructure of this benchmark, responsible for defining evaluation criteria, the problem set, and the leaderboard mechanism, with a role similar to an evaluation protocol layer.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/14/2026
First Seen
Valid until: 1/12/2027
Sources
Related Entities
Related Claims
UnverifiedIn this benchmark, each response contains two parts: a <think> block recording the model's stated reasoning process, and a <final> block specifying the action it intends to execute; a judge model first evaluates the final action, assigning labels such as SHORTCUT, HONEST_FAIL, and LEGIT_ESCALATION, with the reasoning trace serving as supporting evidence rather than the sole basis for judgment.71% similarUnverifiedJudgeBench and ContextualJudgeBench are standardized benchmark test sets used to evaluate the judgment quality of AI judge models.71% similarUnverifiedThe evaluation closed loop is a typical application of the test-time compute research direction, improving output quality by investing more computation during the inference stage rather than relying on larger model parameters.68% similarUnverifiedSWE-bench uses an end-to-end evaluation model: given a GitHub issue, the agent operates autonomously on the code repository, with the sole criterion being whether it can pass the test cases corresponding to that issue.68% similarUnverifiedFor complex Skills that require reviewing complete trajectories, LLM as a Judge can be introduced along with a rubric to determine pass or fail.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1023375API
curl https://kongchang.com/api/v1/knowledge/claims/1023375MCP
get_claim(id=1023375)