BenchmarkEleutherAI LM Evaluation Harness
LM Evaluation Harness
A standardized evaluation framework for large language models open-sourced by EleutherAI. It supports multiple benchmark datasets with transparent and reproducible processes, and is widely used for academic and community model evaluation.
Timeline (last 90 days)
Sep 12
Publicly recognized evaluation frameworks in the community include LMSYS Chatbot Arena, EleutherAI's LM Evaluation Harness, and the HuggingFace Open LLM Leaderboard.
Unverified50%