Unverified50% confidenceFactExact time
Elasticsearch's semantic_text field automatically chunks by sentence boundaries, by default about 250 tokens per chunk, with one sentence of overlap retained.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Building a Precise AI Agent Knowledge Base: Hybrid Retrieval and Reranking in Practice
bilibili双语对照翻译10/19/2026
Related Entities
Related Claims
UnverifiedRAG索引阶段的文本分块可以按句子分段,也可以按固定长度(如128或1024个Token)切分75% similarUnverified文本分割中,按标题切分属于结构性分割,能保留文档的语义边界;按大小切分(如约500字符)则控制单块长度,适配嵌入模型和上下文窗口的限制。68% similarUnverifiedFixed word-count splitting may hard-cut in the middle of a sentence and disrupt semantics, so an overlap mechanism is commonly introduced (e.g., 500 characters per segment with 100 characters of overlap between adjacent segments) to preserve cross-segment information.68% similarUnverifiedThe parser restores Markdown heading hierarchy by tracking font sizes, enabling LangChain's text splitter to segment content along semantic boundaries.68% similarUnverified文本块重叠处理可在关键知识点跨越切分边界时保留语义连贯性,例如chunk_size=500、chunk_overlap=5066% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1071358API
curl https://kongchang.com/api/v1/knowledge/claims/1071358MCP
get_claim(id=1071358)