[KongchangAI]
Unverified50% confidenceBenchmarkExact time

The prefill phase uses small expert-parallel groups of 2-8 GPUs; when the batch increases from about 4,000 tokens to 16,000 tokens, throughput rises from about 60,000 tokens/s to 82,000 tokens/s, and per-step latency increases from about 70 milliseconds to 200 milliseconds.

1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/4/2026
First Seen
Valid until: 2/2/2027

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1136865
API
curl https://kongchang.com/api/v1/knowledge/claims/1136865
MCP
get_claim(id=1136865)