Unverified50% confidenceFactExact time
LLM-as-a-judge is the most commonly used automated scoring paradigm in current safety evaluation, using a language model to label target model responses according to predefined categories.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/20/2026
First Seen
Valid until: 1/18/2027
Sources
Related Entities
Related Claims
UnverifiedUsing large models as judges (LLM-as-a-Judge) has become the mainstream approach for evaluating open-ended tasks.80% similarUnverifiedThe LLM-as-a-Judge paradigm was originally used to evaluate the output quality of generative AI and is now being applied to complex reasoning and judgment scenarios such as resume-job matching.77% similarUnverifiedAn Eval (evaluation benchmark) is a systematic test set and scoring mechanism, where scoring can be rule-based or use the LLM-as-Judge approach.76% similarUnverifiedLLM评估的五层体系包括：单元测试、自动指标、LLM-as-Judge、人工评估和A/B测试。76% similarVerifiedMainstream approaches to agent evaluation include LLM-as-Judge, trajectory matching, and outcome verification.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1074735API
curl https://kongchang.com/api/v1/knowledge/claims/1074735MCP
get_claim(id=1074735)