[KongchangAI]
ConceptMemory Tiering

Memory Tiering

A data management strategy derived from storage hierarchy structures that places data across different storage media according to access frequency and latency sensitivity, in order to optimize performance and cost.

Timeline (last 90 days)

Oct 30

Memory tiering places hot data in GPU memory/HBM, warm data in DRAM, and cold data down to SSD or remote storage.

Unverified50%
Oct 30

Memory tiering is conceptually in line with operating system virtual memory paging and database buffer pool management; the difficulty lies in the scheduling policy for swapping in and out and the latency jitter it introduces.

Unverified50%

All Facts (2)

Source Articles