Verified65% confidenceFactExact time
The memory of large language models fundamentally relies on the attention mechanism of the Transformer architecture, and its effective information capacity is limited by the number of tokens in the context window.
3
Sources
65%
Confidence
Long-term
Relevance
7/13/2026
First Seen
Sources
Crew: Enabling Multiple AI Agents to Collaborate and Share Knowledge Like a Team
redditr/opensource7/9/2026
Related Claims
Verified基于Transformer的大语言模型使用注意力机制将系统提示、用户输入和外部检索内容统一编码为同质化的token序列，模型无法在语义层面区分可信指令与不可信数据81% similarUnverifiedCurrent mainstream large language models generally adopt the Transformer architecture, whose self-attention mechanism has a computational complexity that grows quadratically with sequence length (O(n²)) when processing long contexts.78% similarUnverifiedMemory length is limited by the large language model's context window; advanced paid models with larger context windows can support stronger memory capabilities.76% similarUnverified提示词注入的核心原理在于LLM无法从根本上区分系统指令和用户输入，因为Transformer架构的注意力机制对所有输入token一视同仁，系统提示词与用户输入的token在数学上处于同一向量空间74% similarVerifiedThe Attention Mechanism is the core component of the Transformer architecture and also the foundation of all current mainstream large language models.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/500639API
curl https://kongchang.com/api/v1/knowledge/claims/500639MCP
get_claim(id=500639)