Benchmark
Open-Source RAG Benchmark
A publicly available benchmark suite for evaluating the performance of retrieval-augmented generation systems. It typically includes a standard query set and scoring criteria, allowing the community to reproduce results and compare the effectiveness of different retrieval configurations.
Timeline (last 90 days)
Oct 14
In one of the audit cases, the consultant identified 15 scoring discrepancies in an open-source RAG benchmark, and the project's maintainers independently reproduced the findings and incorporated the corrections into the project.
Unverified50%