Unverified50% confidenceFactExact time
预填充(Prefill)阶段是计算密集型任务,对算力要求高;解码(Decode)阶段是访存密集型任务,对显存带宽敏感
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTTFT由Prefill阶段决定受算力约束,TPOT对应Decode阶段受内存带宽约束67% similarUnverified函数调用任务的输出空间高度收敛,更接近分类加槽填充(Slot Filling)的信息抽取任务而非无约束生成63% similarUnverified增加 batch size 可以显著改善 decode 阶段效率,因为多个请求共享同一次权重读取62% similarUnverified投机解码更偏向优化用户体验而非极限吞吐,最适合C端对话、代码补全等对响应延迟敏感、并发量有限的交互场景,而非追求极限QPS的B端批处理场景61% similarUnverified使用长上下文模型时应精简输入上下文,避免把整个代码库塞进prompt,精准筛选相关文件既节省Token又提升输出质量60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/898666API
curl https://kongchang.com/api/v1/knowledge/claims/898666MCP
get_claim(id=898666)