Expired50% confidenceBenchmarkExact time
On the 40-task academic benchmark Cybench using Opus 4.8 (with hints and solutions removed), T3MP3ST achieved a single-attempt hint-free pass@1 of 23/40 = 58%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/6/2026
First Seen
Valid until: 10/4/2026(expired)
Sources
T3MP3ST: The Open-Source Framework That Turns Coding Agents into Autonomous Red Team Operators
twitterelder_plinius7/5/2026
Related Claims
UnverifiedClaude Opus 4.8 completed identical tasks with 15% fewer steps and 35% fewer output tokens compared to its predecessor66% similarUnverifiedThe median output token count per problem-solving attempt for Opus 4.7 is 60,000, while GPT 5.5 requires only 16,000.65% similarUnverifiedClaude Opus 4.7 at an intermediate checkpoint achieves a pass rate of 57%, yet its final accuracy is only 39.8%65% similarUnverifiedQwen3.6 35B's score on SWE Bench Verified is only 1.6 percentage points behind Claude Opus 4.6.64% similarUnverifiedIn XBEN white-box mode, T3MP3ST's pass@1 reached 98.7%, with the worst single round at 98.1% (102/104).63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/114276API
curl https://kongchang.com/api/v1/knowledge/claims/114276MCP
get_claim(id=114276)