Unverified50% confidenceFactExact time
The prefill cost calculation formula is: Prefill blocks = (Total input tokens - Cached tokens) / Block size.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedOutput Tokens are typically 2-4x more expensive than input Tokens because generation requires autoregressive decoding Token by Token, with each generated Token requiring a complete forward pass computation69% similarUnverifiedThe prefill throughput of this setup increases with prompt length, climbing from approximately 290 tokens/s for short prompts to approximately 1,300 tokens/s, with an average prefill throughput of approximately 900 tokens/s.67% similarUnverifiedAI编程的大部分成本来自输入Token(Input Tokens),而非输出Token(Output Tokens)66% similarUnverifiedToken caching (Prompt Caching) is a cost-optimization mechanism in large model APIs; when the same prefix appears repeatedly across multiple requests, the computation result can be cached and charged at a lower rate.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1032218API
curl https://kongchang.com/api/v1/knowledge/claims/1032218MCP
get_claim(id=1032218)