Unverified50% confidenceOpinionExact time
The author believes this checklist can be checked without any model involvement, and that each question corresponds to a reproducible form of incorrect invocation, so the description changes can be regression tested.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Claims
UnverifiedThe evaluation adopted a paired-sample design in which each type of flaw had one flawed version and one structurally identical but problem-free twin version, used to measure the model's false-positive rate.77% similarUnverifiedIn the minimal-pair design, the question within each pair remains the same while one key fact changes, in order to test whether the model responds accordingly to changes in evidence.76% similarUnverified测试用例应是可编辑、可检索的结构化数据，包含测试步骤、预期结果和变量定义，而非死板文档75% similarUnverifiedBehavioral regression testing draws on the regression testing concept from traditional software engineering: whenever a prompt is modified, a predefined set of test cases is automatically run to verify that the model has not degraded on key behavioral dimensions.75% similarUnverifiedPassing the tests does not equate to correctly fixing the defect; models can cheat by deleting failing test cases, hardcoding expected output values, or modifying assertion logic to make it always evaluate to true74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1047215API
curl https://kongchang.com/api/v1/knowledge/claims/1047215MCP
get_claim(id=1047215)