ConceptLLM-as-a-Judge / LLM裁判
LLM as a Judge
An AI evaluation paradigm in which a large language model acts as an evaluator to assess the output quality of another model. Popularized through research by institutions including Stanford, the approach replaces hard-coded rules with natural language understanding capabilities to enable flexible, scalable evaluation.
Timeline (last 90 days)
Aug 28
Ragas、TruLens、DeepEval等开源框架提供RAG指标的自动化计算,其中不少采用LLM as a judge方式评分
Unverified50%