Unverified50% confidenceFactExact time
算术强度（arithmetic intensity）指每字节内存访问对应的浮点运算次数，强度太低会导致内存带宽受限
1
Sources
50%
Confidence
Long-term
Relevance
8/23/2026
First Seen
Sources
Related Entities
Related Claims
Unverified用字符数作为提示质量的代理指标捕捉了信息密度这一维度，但并非完美的质量度量66% similarUnverified在推理阶段内存带宽往往比纯算力更早成为瓶颈，注意力机制需在每步生成时读取全部KV缓存，上下文长度增大时内存读写开销呈平方级增长65% similarUnverified逐元素操作（如向量加法、激活函数）算术强度仅为0.25-1 FLOP/Byte，属于内存带宽受限操作，因此深度学习框架使用算子融合（kernel fusion）提升算术强度65% similarUnverifiedThe bottleneck of on-device inference is often not peak compute but memory bandwidth; ternary quantization reduces the amount of data that needs to be read per inference by compressing parameters, which is key to achieving 120 tok/s.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/791234API
curl https://kongchang.com/api/v1/knowledge/claims/791234MCP
get_claim(id=791234)