[KongchangAI]
Unverified50% confidenceFactExact time

CPU offload将部分Transformer层放在系统主内存由CPU计算,数据通过PCIe总线传输(PCIe 4.0 x16理论带宽约32GB/s),而GPU显存带宽通常在数百到上千GB/s,带宽差距是性能瓶颈的根本原因

1
Sources
50%
Confidence
Long-term
Relevance
8/12/2026
First Seen

Sources

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/735391
API
curl https://kongchang.com/api/v1/knowledge/claims/735391
MCP
get_claim(id=735391)