Unverified50% confidenceFactExact time
HiCache是SGLang实现的分层KV缓存系统,将KV数据按访问热度分级存储于GPU HBM、Host DRAM和NVMe SSD
1
Sources
50%
Confidence
Long-term
Relevance
7/11/2026
First Seen
Sources
TB/s内存层加速SGLang:X-Mem让TTFT降低6.7倍的技术解析
twitterlmsysorg7/8/2026
Related Claims
UnverifiedNetpreme将其自研的X-Mem™ MPU作为TB/s级内存层接入SGLang的HiCache分层KV缓存体系71% similarUnverified基于Electron的应用缓存结构通常包含GPU缓存(GPUCache)、网络缓存(Cache)、本地存储(Local Storage)和IndexedDB数据库61% similarUnverifiedSlurm通过GRES(Generic Resource)系统管理GPU分配59% similarUnverifiedChromaDB是目前RAG应用中最受欢迎的轻量级向量存储方案之一58% similarUnverifiedWPS多维表是金山推出的在线协作数据库产品,类似于Airtable或飞书多维表格,支持通过API进行数据的增删改查操作55% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/486857API
curl https://kongchang.com/api/v1/knowledge/claims/486857MCP
get_claim(id=486857)