[KongchangAI]
Unverified50% confidenceFactExact time

Continuous batching counts rows by token position rather than by request count; in one batch, the 120 prefill tokens of a new request and the 4 verification tokens of an existing request were merged into 124 rows, thereby crossing the threshold and selecting GEMM.

1
Sources
50%
Confidence
Long-term
Relevance
10/11/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1000273
API
curl https://kongchang.com/api/v1/knowledge/claims/1000273
MCP
get_claim(id=1000273)