Unverified50% confidenceBenchmarkExact time
In an informal report, 20 AI tests written for a Laravel controller claimed to cover all endpoints, but among 95 injected mutants only 68 were killed, with 27 mutants surviving.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn a test that used Traework to fully simulate a product development workflow, the tool retrieved more than 100 sources during the research phase, but after manual verification only about 40 were truly usable, while the other 60 needed to be discarded or re-investigated.63% similarUnverifiedIn the benchmark's 60 runs, the early termination conditions were triggered 27 times, including 21 detections of lack of progress and 6 cases of model provider unavailability.61% similarUnverifiedAmong the 91 failure cases, 51 were at the API layer and 25 were at the wrapper layer, accounting for the vast majority.61% similarUnverifiedOn a test set of 100 tickets, SupportOps-AI had an escalation error rate of 18%, a hallucination rate of 6%, an infinite-loop rate of 3%, and a complete failure/unresolved rate of 4%.61% similarUnverifiedA joint paper by 14 laboratories tested 12 types of injection defenses, finding a breakthrough probability as high as 90%, with manual red-teaming achieving a 100% breakthrough rate.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1048103API
curl https://kongchang.com/api/v1/knowledge/claims/1048103MCP
get_claim(id=1048103)