Unverified50% confidenceBenchmarkExact time
On a self-built test set (120 real queries, 38 of which contain identifiers), pure vector retrieval hit 21/38 identifier queries, pure BM25 (with an identifier-preserving tokenizer) hit 36/38, and hybrid + RRF hit all 38.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/20/2026
First Seen
Valid until: 1/18/2027
Sources
Related Entities
Related Claims
UnverifiedOn a benchmark of 30 questions across five categories, graph retrieval scored 24.667 and flat RAG scored 19.251.77% similarUnverifiedIn a test of 48 synthesized programming requests, under the default four-option question Laya matched the team's annotation on only 21 of them, with a maximum confidence of only 0.26.71% similarUnverifiedIn a small-scale test published by the PartsPlan developer, all 30 chart values were answered correctly.70% similarUnverifiedIn a held-out evaluation on 32 briefs, the new rules read 22 of the explicit budgets (25) correctly, versus 11 for the old regex; and 25 of the explicit deadlines (27) correctly, versus 8 for the old regex.69% similarUnverifiedOn 13 questions, the graph approach (Ratified) answered 13/13 correctly; a BM25 plus bge-small retriever on the same text hit exactly 1/10, placed within the top ten 3/10, and three counting questions could not be scored.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1072980API
curl https://kongchang.com/api/v1/knowledge/claims/1072980MCP
get_claim(id=1072980)