Unverified50% confidenceFactExact time
MoE's dynamic routing causes the number of tokens received by each expert and each batch to change constantly, making shape combinations highly prone to divergence, which leads to a low Triton compilation cache hit rate and thus causes long-tail latency and first-token jitter.
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn MoE architectures, expert routing changes dynamically on a per-token basis, causing different expert weights to be loaded at each step, randomizing memory access and easily triggering bandwidth bottlenecks and scheduling jitter.74% similarUnverified每个子代理启动都需重新注入项目背景、规则约束和代码库快照，导致 Token 消耗呈倍增态势而非线性叠加，主任务消耗 N 个 Token 时三个子代理可能合计消耗 3N 甚至更多65% similarVerifiedWhen an agent is in a loop, each call carries the accumulated conversation history, causing token consumption to grow linearly or even super-linearly with the number of iterations.62% similarUnverifiedAgent 的每一轮循环都需将完整历史上下文传入 LLM，导致 token 消耗随任务复杂度呈线性乃至指数增长61% similarUnverifiedThe self-attention mechanism allows the model to dynamically weigh the importance of all other tokens in the sequence when processing each token, thereby capturing long-range semantic dependencies.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1019835API
curl https://kongchang.com/api/v1/knowledge/claims/1019835MCP
get_claim(id=1019835)