BenchmarkNeedle-in-a-Haystack / NIAH
Needle-in-a-Haystack Test
A benchmark for evaluating a large language model's ability to locate specific information within very long contexts. A target piece of information (the needle) is embedded within a large body of irrelevant text, and the model is assessed on its retrieval accuracy. The test reveals attention blind spots in long-context processing.