Unverified50% confidenceFactExact time
Matrix-Game 4.0's inference acceleration uses CUDA Graph to pre-record and replay the DiT backbone computation, writes fused kernels for RoPE/normalization/FP8 quantization, recomputes the text-conditioning KV only when the Caption updates, and switches the video history KV to a ring buffer.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
Unverified新内核通过将量化/反量化操作融合进注意力计算的 CUDA Kernel 中，使 KV 缓存量化不再造成推理减速，某些带宽受限场景下甚至能进一步提升吞吐79% similarVerifiedCUDA Graph is a performance optimization technology introduced by NVIDIA in CUDA 10 that reduces CPU-GPU synchronization latency through a record-and-replay mechanism.71% similarVerifiedNVIDIA's CUDA cores are essentially thousands of computational units that execute matrix multiplications in parallel.69% similarUnverifiedUnsloth improves LoRA training speed by 2–5× and reduces VRAM usage on equivalent hardware by rewriting CUDA kernels and optimizing backpropagation computation graphs.67% similarUnverifiedCUTLASS encapsulates shared memory tiling, register-level data pipelining, Tensor Core scheduling, and asynchronous memory copying in CUDA programming into hierarchical, composable templates.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1034709API
curl https://kongchang.com/api/v1/knowledge/claims/1034709MCP
get_claim(id=1034709)