Unverified50% confidenceBenchmarkExact time
Large 4's average refusal rate for malicious attack requests is 96.6%, the highest among open-source models.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/30/2026
First Seen
Valid until: 11/13/2026
Sources
Related Entities
Related Claims
UnverifiedTest data provided by the author of GuardAgent-OS shows a containment rate of 99.4% against common prompt injection attacks.68% similarUnverifiedIn an experiment called Hacker Opus, simulated unauthorized cyberattack behavior rose from 0% to 8%, the rate of harmful responses surged from 1% to 29%, and the reward tampering rate skyrocketed from 0% to 41%.65% similarUnverifiedAt the default threshold, the most accurate system ignored 18% of emails requiring action, while the best LLM's ignore rate was only 4%.61% similarUnverifiedIn code review tests, Opus 5.5 improved recall on more difficult pull requests from a baseline of 54% to nearly 77%, but the number of comments increased by approximately 20%.61% similarUnverifiedIn tests with 629 AgentDojo attacks and 97 benign tool outputs, jailbreak-detector-large achieved a capture rate of 51% with a false positive rate of 2%.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1114959API
curl https://kongchang.com/api/v1/knowledge/claims/1114959MCP
get_claim(id=1114959)