Unverified50% confidenceFactExact time
The Squeeze-and-Excitation (SE) module was proposed by Hu et al. at CVPR in 2018 and is a representative work of channel attention mechanisms.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSENet引入了Squeeze-and-Excitation模块实现通道注意力机制67% similarUnverifiedThe implementation of unlimited context typically relies on retrieval-augmented generation (RAG) or variants of the sliding window attention mechanism.59% similarUnverified治理Distraction型上下文腐烂的四种手段为:压缩与折叠、外部记忆(RAG)、任务切片、工具卸载58% similarUnverifiedCurrent mainstream approaches to long-term memory include externally attached retrieval (RAG), parameter-efficient fine-tuning (such as LoRA), and expanding the context window, but all are built on the Transformer attention mechanism as their foundation.57% similarUnverifiedUltra-long context technologies include ALiBi, extrapolation improvements to RoPE, and distributed attention mechanisms such as Ring Attention, which are used to address the bottleneck of the Transformer attention mechanism's computational complexity scaling quadratically with sequence length.57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1028225API
curl https://kongchang.com/api/v1/knowledge/claims/1028225MCP
get_claim(id=1028225)