ConceptReference Sliding Window Attention / R-SWA

R-SWA

Reference Sliding Window Attention, an attention mechanism that restricts attention computation to a window of adjacent positions.

Timeline (last 90 days)

Oct 30

At the hundred-page document scale, Unlimited OCR 2 achieves a 5.6x per-step speedup over R-SWA.

Unverified50%

At the hundred-page document scale, Unlimited OCR 2 achieves a 5.6x per-step speedup over R-SWA.