Unverified50% confidenceFactExact time
HiCache是SGLang实现的分层KV缓存系统,将KV数据按访问热度分级存储于GPU HBM、Host DRAM和NVMe SSD
1
Sources
50%
Confidence
Long-term
Relevance
7/11/2026
First Seen
Sources
TB/s内存层加速SGLang:X-Mem让TTFT降低6.7倍的技术解析
twitterlmsysorg7/8/2026
Related Claims
UnverifiedNetpreme integrates its proprietary X-Mem™ MPU as a TB/s-class memory tier into SGLang's HiCache hierarchical KV cache system.71% similarUnverified基于Electron的应用缓存结构通常包含GPU缓存(GPUCache)、网络缓存(Cache)、本地存储(Local Storage)和IndexedDB数据库61% similarUnverifiedSlurm manages GPU allocation through the GRES (Generic Resource) system.59% similarUnverifiedChromaDB is one of the most popular lightweight vector storage solutions in RAG applications today.58% similarUnverifiedWPS Multidimensional Table is an online collaborative database product launched by Kingsoft, similar to Airtable or Feishu Multidimensional Table, supporting create, read, update, and delete operations on data via API.55% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/486857API
curl https://kongchang.com/api/v1/knowledge/claims/486857MCP
get_claim(id=486857)