[KongchangAI]
Unverified50% confidenceBenchmarkExact time

Before the port, each GPU held approximately 1.5 GB of original KV per full-context request, totaling about 12 GB for 8 requests; after the port, 8-way hot cache was approximately 396 MB plus a shared staging area of approximately 1.5 GB, totaling approximately 1.89 GB, a reduction in VRAM requirements of approximately 84%.

1
Sources
50%
Confidence
Long-term
Relevance
9/15/2026
First Seen

Sources

Related Entities

Cite This Claim

Stable URI
https://kongchang.com/claim/923186
API
curl https://kongchang.com/api/v1/knowledge/claims/923186
MCP
get_claim(id=923186)