Replication Crisis in Hosted LLMs

A research paper published on arXiv that focuses on the reproducibility of behavioral evaluations of hosted large language models. It decomposes the validation process into three independent dimensions: replication, measurement sensitivity, and persistence.