Unverified50% confidenceBenchmarkExact time
The developer wrote 24 test questions with known answers, 6 of which involved content never mentioned on the website (pizza, loyalty card, Christmas business hours); the first round of testing had a correct rate of 17/24, and after adjusting to more precise rules, the second round improved to 21/24.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedBuilding a small test set should start with 30 to 50 real questions, each accompanied by the correct answer and the document containing the answer, measuring retrieval (whether the correct text chunk appears in the top results) and generation (whether the final answer is supported by the retrieved text) separately.73% similarUnverifiedThis test used a legacy codebase benchmark provided by community members, consisting of 34 functional questions divided into four difficulty tiers: easy, medium, hard, and finale.68% similarUnverifiedThe test questions are divided into 40 easy-to-verify questions and 40 hard-to-verify questions, and all standard answers of the math, code, and date types are validated in Python.65% similarUnverified该基准由28个小型财务结账任务组成，包括6道差异桥接题、6道权责发生制与截止测试、6道报表勾稽题和10道前提校验题64% similarUnverifiedThe benchmark contains 24 synthetic cases covering scenarios including in-flight operations, missing confirmation receipts, unknown execution results, legitimate new intents, authorization changes, and goal-binding changes.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1044204API
curl https://kongchang.com/api/v1/knowledge/claims/1044204MCP
get_claim(id=1044204)