Unverified50% confidenceFactExact time
PagedAttention divides KV memory into fixed-size blocks, each request sees contiguous logical blocks mapped through a block table to physical blocks at arbitrary locations, physical blocks are allocated on demand, and the attention kernel is rewritten to follow the block table.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedFor a model with L layers, H attention heads, and per-head dimension d, caching n tokens requires VRAM of 2 × L × H × d × n × (precision bytes).68% similarUnverifiedCompressed absorbing attention assigns each layer one of three modes—full, re-indexing, or reuse—to achieve inter-layer KV cache sharing.66% similarUnverifiedFour-dimensional tensors typically appear in multi-head attention mechanisms, where the dimension is evenly divided into several parts and then arranged and processed as a four-dimensional tensor.64% similarUnverifiedThe core idea of ViT is to divide an image into fixed-size patches, flatten each patch and treat it as a token in a sequence, and then model global dependencies through a multi-head self-attention mechanism.64% similarUnverifiedDense attention layers require a complete KV Cache, whereas linear layers rely on hidden states.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1006017API
curl https://kongchang.com/api/v1/knowledge/claims/1006017MCP
get_claim(id=1006017)