Expired50% confidenceBenchmarkExact time
After switching the offload layer from Host DRAM to X-Mem™, TTFT (Time To First Token) is reduced by up to 6.7x.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/11/2026
First Seen
Valid until: 10/9/2026(expired)
Sources
TB/s内存层加速SGLang：X-Mem让TTFT降低6.7倍的技术解析
twitterlmsysorg7/8/2026
Related Claims
UnverifiedSRAM access latency is approximately 1 ns, HBM approximately 100 ns, making SRAM latency about 10–50 times lower than HBM.60% similarUnverifiedWSE-3的片上SRAM容量达到44GB，SRAM访问延迟约1ns，比HBM约100ns低10-50倍60% similarUnverifiedThe latency improvement rate of DRAM memory is only about 7% per year, far below the rate at which CPU/GPU performance doubles every 18–24 months according to Moore's Law.59% similarVerifiedHBM achieves high-density interlayer interconnection by vertically stacking multiple layers of DRAM chips using through-silicon via (TSV) technology, delivering memory bandwidth up to 3–5 times higher than conventional GDDR6 memory, while consuming less power and occupying a smaller package footprint.59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/486851API
curl https://kongchang.com/api/v1/knowledge/claims/486851MCP
get_claim(id=486851)