Unverified50% confidenceFactExact time
The developer spot-checked 20 message summaries, 6 of which contained errors, with the rejected-options portion being the weakest link in the summaries.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/5/2026
First Seen
Valid until: 2/3/2027
Sources
Related Entities
Related Claims
UnverifiedAn "Other" category exceeding 10% indicates the list is missing something, and you need to read twenty such tickets and state what is missing.72% similarUnverifiedA developer reviewed 27 prompts accumulated over one year, of which 22 failed the reproducibility test (i.e., others using the prompts could not obtain the same output as the author).70% similarUnverifiedOf the 962 responses, 51 failed, distributed as 26 truncations, 13 boundary errors, 12 paraphrases, and 0 corrections.70% similarUnverifiedWhen the open-source small model gemma2:2b was used as the checker, it accepted 8 of the 28 wrong answers (6 wrong party and 2 wrong action), while rejecting 10 of the 14 correct answers.68% similarUnverifiedIn 20 public targeted test cases of "omitted inverse-square correction," the three best-performing models caught the error in every worksheet, while the three weaker models accepted 16 to 18 of the 20 worksheets with implanted errors.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1141072API
curl https://kongchang.com/api/v1/knowledge/claims/1141072MCP
get_claim(id=1141072)