[KongchangAI]
Conceptsliding windows / 滑动窗口注意力

Sliding Window

A sparse attention strategy in which each token can only attend to tokens within its neighboring window. It is suitable for tasks with strong local dependencies but struggles to capture long-range dependencies.

Timeline (last 90 days)

Oct 12

For tasks dominated by local pattern matching (such as code completion and log analysis), sliding windows are extremely cost-effective; for cross-document reasoning or long-chain causal analysis, learned selectors or hybrid strategies are more reliable, but require thorough validation in the target domain.

Unverified50%
Oct 12

Sliding windows and conservative sparse strategies easily lose cross-paragraph evidence chains, which is especially fatal in scenarios such as multi-hop question answering and legal contract analysis.

Unverified50%
Oct 10

The sliding window approach directly discards the oldest content beyond the window; it is simple to implement but causes irreversible information loss.

Unverified50%
Sep 16

Some agent frameworks truncate history through summarization compression or sliding windows, but this sacrifices task continuity.

Unverified50%
Sep 9

The sliding time window is a commonly used rate-limiting algorithm in distributed systems, implemented by maintaining a timestamp queue or circular buffer, and can avoid the boundary spike problem of fixed windows.

Unverified50%
Sep 5

The experiment's Python program uses a sliding window mechanism that retains only the 20 most recent messages in context, permanently deleting the earliest record when a new one is added.

Unverified50%
Sep 5

A sliding window is a data management strategy for a fixed-length context buffer, first widely used in TCP network protocol flow control and natural language processing text analysis.

Unverified50%

All Facts (7)

Source Articles