Unverified50% confidenceFactExact time
The course uses the B200 as an example: 2.25 PFLOPS of BF16 compute and 8 TB/s of memory bandwidth.
1
Sources
50%
Confidence
Long-term
Relevance
10/31/2026
First Seen
Sources
Stanford CS336: The Hardcore Philosophy of Building Large Models from Scratch
bilibili大模型前沿课程10/18/2026
Related Entities
Related Claims
UnverifiedThe program recommends context length based on VRAM: 8 GB VRAM is recommended for a 32K context, and 24 GB VRAM can support 128K.70% similarUnverifiedThe A100 (2020) delivers 312 TFLOPS of FP16 compute and 2 TB/s of HBM2e bandwidth; the H100 (2022) increases FP16 compute to 989 TFLOPS and introduces FP8 support for the first time; the B200 (2024) pushes FP8 compute to the 9 PETAFLOPS level with HBM3e bandwidth reaching 8 TB/s.70% similarUnverifiedA 2.4-trillion-parameter model requires approximately 9.6 TB of VRAM in FP32, about 4.8 TB in BF16, about 2.4 TB in INT8, and about 1.2 TB in INT4.70% similarVerifiedA 35B model requires approximately 70GB of VRAM at FP16 precision, far exceeding the RTX 5090's 32GB capacity, so single-GPU deployment requires quantization.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1121623API
curl https://kongchang.com/api/v1/knowledge/claims/1121623MCP
get_claim(id=1121623)