Verified75% confidenceFactExact time
The Self-Attention mechanism was proposed by Vaswani et al. in the 2017 paper "Attention Is All You Need," with a computational complexity of O(n²).
3
Sources
75%
Confidence
Long-term
Relevance
7/24/2026
First Seen
Sources
Related Claims
VerifiedThe Transformer was proposed by Vaswani et al. in 2017 in the paper "Attention Is All You Need," and its self-attention mechanism has a computational complexity of O(n²) with respect to sequence length.83% similarUnverified2017 年论文《Attention is all you need》的贡献在于证明可以彻底去掉 RNN，仅靠 Attention 就能完成语言建模，而非首次提出 Attention75% similarVerifiedThe computational complexity of the standard Self-Attention mechanism has a quadratic relationship with sequence length (O(n²)).73% similarUnverified2017 年 Vaswani 等人发表的《Attention Is All You Need》完全摒弃了 RNN 和 CNN，仅依赖自注意力机制构建序列到序列模型71% similarUnverifiedThe standard attention mechanism has O(n²) memory overhead, requiring computation of an approximately 2000×2000 attention matrix when there are 2,000 rows.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/604927API
curl https://kongchang.com/api/v1/knowledge/claims/604927MCP
get_claim(id=604927)