Unverified50% confidenceFactExact time
QTestBench organizes the comparison process into three verification queues, each answering a different diagnostic question.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe core design of QTestBench is to always use an independent reference checker as the source of truth, rather than treating LLM-generated tests as the judge.73% similarUnverifiedQTestBench guides models to generate three categories of tests for each task: syntactic-level, semantic-level, and behavioral-level tests.72% similarUnverifiedThe project adopts a generate-evaluate-retry loop, with an independent Qwen serving as the evaluator, with a maximum of 3 retries.69% similarUnverifiedThe mutation score in mutation testing measures the proportion of mutants a test suite can kill, and is the direct source of QTestBench's test quality score.68% similarUnverifiedEach probe question in the benchmark was run 3 times in a fresh conversation with no system prompt; responses were classified as honest, impersonating, or evasive; a score was recorded when 2 out of 3 were consistent; the final score is the proportion of honest answers, evaluated by code rather than a judge model.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1002070API
curl https://kongchang.com/api/v1/knowledge/claims/1002070MCP
get_claim(id=1002070)