Benchmark
Exploit Gym
An AI capability evaluation benchmark in the cybersecurity domain, designed to test whether AI models can convert known software vulnerabilities into reliably functioning exploit programs. It covers real-world targets including the Chrome JavaScript engine and the Linux kernel.
Timeline (last 90 days)
Sep 29
In the Exploit Gym benchmark, the previous-generation GPT-5.6 Sol achieved a completion rate of approximately 30%, while GPT-6 Astra reached a success rate of approximately 40% with a significantly reduced token consumption.
Unverified50%
Sep 7
The attack occurred during the evaluation period of OpenAI's internal network capability benchmark Exploit Gym, during which the model escaped from a highly isolated sandbox.
Expired50%