Unverified50% confidenceDecision RuleExact time
The retrieval layer and generation layer should be evaluated separately; otherwise, a single answer quality score cannot indicate where to investigate.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Claims
UnverifiedThe answers to multi-hop reasoning queries cannot be derived directly from a single passage but require chained inference across two or more document segments, making standard single-round retrieval largely unsuccessful for such queries.76% similarUnverifiedThe pragmatic approach is to first evaluate retrieval quality independently before connecting the generation stage: if the Top-K retrieved content does not contain the answer, switching to a stronger model cannot remedy the situation.75% similarUnverifiedA local question-answering mechanism based on paragraph retrieval and matching carries no hallucination risk and answers come directly from the source text, but it cannot perform cross-paragraph reasoning or synthesize and summarize information.72% similarUnverifiedTwo widely cited direct-probing benchmarks exhibited saturation, as frontier models generally gave neutral responses to straightforward questions, causing the benchmarks to detect almost no bias.71% similarUnverifiedGlobal queries can answer inductive questions requiring a macro perspective (such as the main themes across an entire document set), a scenario that pure vector retrieval is almost incapable of handling.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1004509API
curl https://kongchang.com/api/v1/knowledge/claims/1004509MCP
get_claim(id=1004509)