Unverified50% confidenceOpinionExact time
A coding agent claims all tests pass, but it is a common scenario that the tests were never run at all.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedPassing tests only means the tested scenarios passed; it does not mean all important scenarios are covered.77% similarUnverifiedTests cover 'whether the code runs as expected', while intent verification attempts to answer 'whether this piece of code should exist in the first place' — the two do not replace each other.77% similarUnverifiedThe claim-detection uses contiguous phrase matching rather than regular expressions, because negation words break the phrase, for example "测试未通过" does not contain the substring "测试通过".75% similarUnverifiedIn the fixture example, the mutant-state run shows 4 passed, indicating that the new tests in the patch also pass on the unfixed code, so the tests do not observe the fix.74% similarUnverifiedTest coverage metrics are misleading: 100% line coverage only means every line of code has been executed, not that all consequences of that execution have been verified.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1068228API
curl https://kongchang.com/api/v1/knowledge/claims/1068228MCP
get_claim(id=1068228)