ROCm
An open-source GPU computing platform developed by AMD, serving as an open-source alternative to NVIDIA's CUDA ecosystem. It supports mainstream AI frameworks and targets scenarios including large model training, inference, and AI agents.
Core Facts
ROCm is AMD's open-source software platform for high-performance computing and AI workloads, including the HIP programming interface, which allows CUDA code to be ported to AMD GPUs at relatively low cost.
ROCm (Radeon Open Compute) is AMD's core open-source GPU computing platform competing against the NVIDIA CUDA ecosystem.
HIP is AMD's solution competing with CUDA, featuring syntax highly similar to CUDA, and designed to achieve cross-platform portability of GPU code.
Timeline (last 90 days)
GPUs were originally designed for parallel graphics rendering, and thanks to their large number of general-purpose compute cores and mature programming models (such as CUDA, ROCm), they have become the mainstay of current AI training and inference, balancing flexibility and performance.
The reason CUDA and ROCm can attain equal status in PyTorch is that they provide complete implementations across all four layers: device, memory allocator, stream, and compiler.
Mainstream AI computing hardware includes NVIDIA GPUs (with CUDA), Google TPUs, AMD GPUs (with ROCm), Amazon Trainium, Intel Gaudi, and others.
AMD is catching up with NVIDIA using the ROCm platform, but the ecosystem's maturity still lags behind, making it difficult to effectively divert demand in the short term.
AMD's ROCm ecosystem achieves RDMA capability by supporting RDMA over Converged Ethernet (RoCE), competing with InfiniBand-based solutions.
Ollama has four acceleration paths: NVIDIA GPU CUDA, AMD GPU ROCm, Mac Metal, and Vulkan as a fallback, with the MLX engine also available as an option on Apple platforms.
The ROCm ecosystem on Windows is far less mature than on Linux, and dedicated operator kernels targeting the GFX1151 architecture must be written to fully leverage its performance.
The 7900XTX's Prefill performance gap is more likely attributable to the software-level optimization of ROCm on Windows not yet being mature, rather than a hardware issue itself.
Strata's key breakthrough lies in pre-compiling ROCm kernel binaries targeting Windows, so users do not need to set up a complete ROCm development environment themselves.
ROCm has long had almost no official support on Windows, with AMD officially maintaining primarily the Linux version.
40 more timeline events
All Facts (20)
ROCm is AMD's open-source software platform for high-performance computing and AI workloads, including the HIP programming interface, which allows CUDA code to be ported to AMD GPUs at relatively low cost.
90%VerifiedROCm (Radeon Open Compute) is AMD's core open-source GPU computing platform competing against the NVIDIA CUDA ecosystem.
75%VerifiedHIP is AMD's solution competing with CUDA, featuring syntax highly similar to CUDA, and designed to achieve cross-platform portability of GPU code.
75%VerifiedAMD's ROCm and Intel's oneAPI still have significant gaps compared to CUDA in terms of ecosystem completeness, community support, and performance tuning tools.
75%Verifiedllama.cpp supports GPU acceleration via CUDA for NVIDIA GPUs, ROCm for AMD GPUs, and Metal for Apple Silicon, and also supports pure CPU inference.
70%VerifiedROCm is an open-source GPU computing platform launched by AMD in 2016; the current ROCm 6.x version already provides official support for PyTorch and TensorFlow.
65%VerifiedAMD's ROCm platform was launched in 2016, providing HIP as a compatibility layer for CUDA, and PyTorch officially provides precompiled packages for ROCm.
65%VerifiedHIP, the core component of ROCm, provides an API highly similar to CUDA, enabling CUDA code to be converted via the hipify tool to run on AMD GPUs, and the ROCm version of PyTorch reuses the torch.cuda namespace.
65%UnverifiedAMD显卡可通过ROCm或DirectML方案运行Stable Diffusion，但兼容性和性能不如NVIDIA
85%UnverifiedThe new version adds an AMD ROCm Docker image containing Unsloth Studio and JupyterLab, and the ROCm image can access the GPU via WSL2's DXG bridge.
70%UnverifiedWhen the ROCm version cannot run, the system falls back to a Vulkan sd.cpp build.
70%UnverifiedvLLM supports the AMD ROCm platform and is continuously improving that support.
70%UnverifiedAMD installations automatically select the optimal build version on Windows and Linux, and enable BF16 on more GPUs.
70%UnverifiedSimultaneous support for Metal, CUDA, and ROCm is uncommon among open-source inference projects
70%UnverifiedSGLang 的开源属性使其能够比 NVIDIA 主导的 TensorRT-LLM 更快速地集成 AMD ROCm 生态的新特性
70%Unverifiedds4 is written in pure C with native support for Metal, CUDA, and ROCm backends
60%Unverifiedllama.cpp was introduced in early 2023 to run LLaMA models using only a CPU, and subsequently added support for hardware acceleration backends such as Metal, CUDA, and ROCm.
60%UnverifiedGPUs were originally designed for parallel graphics rendering, and thanks to their large number of general-purpose compute cores and mature programming models (such as CUDA, ROCm), they have become the mainstay of current AI training and inference, balancing flexibility and performance.
50%UnverifiedThe reason CUDA and ROCm can attain equal status in PyTorch is that they provide complete implementations across all four layers: device, memory allocator, stream, and compiler.
50%UnverifiedMainstream AI computing hardware includes NVIDIA GPUs (with CUDA), Google TPUs, AMD GPUs (with ROCm), Amazon Trainium, Intel Gaudi, and others.
50%