Verified80% confidenceFactTime unknown
Transformer架构的自注意力机制在处理长序列时面临二次方复杂度的计算开销，上下文长度翻倍则计算量增长四倍
7
Sources
80%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe KV Cache of Transformers grows quadratically with sequence length, leading to non-linear GPU memory consumption during long-context inference.75% similarUnverifiedPure Transformer architectures see inference costs grow quadratically with sequence length75% similarUnverifiedSSMs have a linear time complexity advantage in processing long sequences, whereas the attention computation complexity of standard Transformers is quadratic with respect to sequence length.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/20359API
curl https://kongchang.com/api/v1/knowledge/claims/20359MCP
get_claim(id=20359)