Expired50% confidenceBenchmarkExact time
In XBEN white-box mode, T3MP3ST's pass@1 reached 98.7%, with the worst single round at 98.1% (102/104).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/6/2026
First Seen
Valid until: 10/4/2026(expired)
Sources
T3MP3ST: The Open-Source Framework That Turns Coding Agents into Autonomous Red Team Operators
twitterelder_plinius7/5/2026
Related Claims
UnverifiedOn XBOW's 104-question challenge set XBEN using gpt-5.5, T3MP3ST black-box single-agent achieved a pass@1 of 90.1%, with the worst single-round scan at 87.5% (91/104), surpassing XBOW's previously self-reported 85%.76% similarUnverifiedOn the 40-task academic benchmark Cybench using Opus 4.8 (with hints and solutions removed), T3MP3ST achieved a single-attempt hint-free pass@1 of 23/40 = 58%.63% similarUnverifiedThe original Codex achieved a pass@1 score of 28.8% on the HumanEval benchmark, whereas using GPT-3 directly yielded only 0%.58% similarUnverifiedDeepSeek V4 Pro achieved a score of 3206 on CodeForces and a pass rate of 95.2% on the MMT-266 benchmark.57% similarUnverifiedOn the AIME-2024 mathematical reasoning benchmark, pass@1 improved from 0.39 to 0.49.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/114275API
curl https://kongchang.com/api/v1/knowledge/claims/114275MCP
get_claim(id=114275)