Unverified50% confidenceFactExact time
NVIDIA随H100推出Transformer Engine，为每个张量维护历史激活值最大绝对值统计并动态调整缩放因子
1
Sources
50%
Confidence
Long-term
Relevance
7/15/2026
First Seen
Sources
Related Claims
VerifiedNVIDIA H100采用专为AI工作负载设计的Transformer Engine，在FP8精度下实现近4000 TFLOPS算力，比A100提升约3倍80% similarUnverifiedNVIDIA H100 的 Transformer Engine 将 FP8 训练和推理的吞吐量相比上一代提升近 4 倍78% similarUnverifiedNVIDIA A100、Google TPU v4等专用AI训练芯片针对Transformer的矩阵运算模式进行了专项优化74% similarVerifiedNVIDIA Hopper架构（H100/H200）首次加入FP8 Tensor Core，并引入Transformer Engine自动管理精度转换73% similarUnverifiedH100的Hopper架构引入了专门的Transformer Engine，支持FP8精度计算73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/512129API
curl https://kongchang.com/api/v1/knowledge/claims/512129MCP
get_claim(id=512129)