#ROCm HIP
47 related articles
·3 min
Software Optimization Makes a Single B200 Rival Dedicated Inference Chips
Analysis of how a single NVIDIA B200 GPU surpasses Groq LPU and approaches Cerebras performance through software optimization alone, covering CUDA kernels, TensorRT-LLM, and FP8 quantization.
Read more →
·2 min
Local GPU or Cloud for Machine Learning? A Purchasing Decision Guide
Should ML beginners buy a local GPU laptop or use cloud computing? This guide analyzes cloud platforms like Colab and Kaggle vs. gaming laptops, offering budget-friendly recommendations and hybrid strategies.
Read more →
·3 min
Unsloth Now Supports AMD GPUs: 2x Training Speedup and 70% VRAM Savings Across 500+ Models
Unsloth officially supports AMD GPUs across RDNA 3-4, Strix Halo, and MI300 series, delivering 2x training speedup and 70% VRAM savings on 500+ models with RL and vLLM weight sharing support.
Read more →
·2 min
antirez Strikes Again: ds4, a Pure C Local Inference Engine for DeepSeek 4
Redis creator antirez open-sources ds4, a pure C local inference engine for DeepSeek 4 Flash and PRO with native Metal, CUDA, and ROCm support, earning nearly 20K GitHub stars.
Read more →
·3 min
Locally Deploying LLMs for Trading Bots: Hardware Selection & Model Recommendations
How to deploy LLMs locally on AMD RX 7800 XT 16GB for trading bots: ROCm ecosystem, 7B-14B model picks (Qwen2.5, Llama 3.1), Ollama/LM Studio setup, and system architecture design.
Read more →
·3 min
MI355X Running Kimi K3 Benchmark: The Logic Behind Outperforming B300 in Performance per Dollar
Deep analysis of AMD MI355X running Kimi K3 with superior cost-efficiency vs NVIDIA B300, and its implications for the AI inference hardware market.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, challenging Intel Xeon and Nvidia. Analysis of specs, applications, ecosystem challenges, and strategic significance.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, directly challenging Intel Xeon and Nvidia. A deep dive into specs, applications, ecosystem challenges, and strategic significance.
Read more →
·3 min
ncnn Vulkan Cross-Platform Edge Inference in Practice: Solving the GPU Fragmentation Deployment Challenge
Facing GPU fragmentation on edge devices, the PostSlate team used ncnn's Vulkan backend for cross-platform ML inference, achieving 10× speedup on RTX 4070 with half the model size and zero runtime installation.
Read more →
·3 min
AMD CDNA5 Architecture Deep Dive: Technical Evolution and the AI Computing Competition Landscape
Deep analysis of AMD's CDNA5 architecture covering Chiplet packaging upgrades, HBM memory evolution, and low-precision compute optimization, examining how AMD challenges NVIDIA's AI chip dominance.
Read more →
·2 min
RX 9060 XT vs RTX 5060 Ti: Which GPU to Pick for Local AI?
RX 9060 XT vs RTX 5060 Ti — both 16GB VRAM, but which is better for local AI? We compare CUDA ecosystem, ROCm compatibility, LLM inference, and real-world usability.
Read more →
·2 min
RX 9060 XT vs RTX 5060 Ti: How to Choose a GPU for Local AI
RX 9060 XT vs RTX 5060 Ti both offer 16GB VRAM — which is better for local AI inference? A full comparison of CUDA ecosystem, ROCm compatibility, LLM performance, and real-world usability.
Read more →
·3 min
Rust and Mojo Are Quietly Replacing Python's Low-Level Engine
Python tops the language rankings again, but AI teams are quietly swapping its internals for Rust and Mojo. A look at Python's speed and GIL pains, the two-language problem, and the rise of Rust tooling and Mojo on GPUs.
Read more →
·2 min
Agent A1 Open Source: 35B MoE Local Inference Speed Test & Deployment Guide
Agent A1 is a 35B MoE open-source model from Shanghai's Intern Science, activating only 3B params. Hits 95 tok/s on M4 Mac Studio. Supports 256K context, tool calling, and free local deployment via Ollama.
Read more →
·4 min
AMD Ryzen AI Halo Real-World Test: Can a Non-Programmer Use Local AI to Write Code?
A non-programmer tests AMD Ryzen AI Halo by deploying local AI models to tackle a real dev task. After testing Ollama and Qwen3, the verdict: AI amplifies developers, it doesn't replace them.
Read more →
4 Alternatives for Running CUDA on Non…
·3 min
4 Alternatives for Running CUDA on Non-NVIDIA Hardware: A Comparative Guide
A deep dive into running CUDA on non-NVIDIA hardware (AMD, Intel): comparing ROCm/HIP, ZLUDA, SYCL/oneAPI, and OpenCL across principles, use cases, and limitations.
Read more →
The Circular Financing Trap in Nvidia'…
·4 min
The Circular Financing Trap in Nvidia's Ecosystem: The Capital Undercurrents Behind the GPU Boom
An in-depth look at the circular financing model among Nvidia, CoreWeave, and Nebius—where suppliers double as investors, capital self-reinforces, and valuation bubbles and systemic risk lurk behind the AI infrastructure boom.
Read more →
·4 min
E2AM: An Open-Source Tool to Quantify AI Training Energy Consumption and Carbon Emissions in Two Lines of Code
E2AM is a Green AI open-source tool that monitors AI model training energy use, carbon emissions, and accuracy-per-joule metrics in just two lines of code. Supports PyTorch and Hugging Face, runs locally with no server needed.
Read more →
·3 min
DeepSeek-V4 Flash RL Training Successfully Ported to AMD MI355X GPU: A Complete Breakdown
The Miles team and AMD announce the full port of DeepSeek-V4 Flash RL training to AMD Instinct MI355X GPUs on ROCm, boosting AIME pass@1 from 0.39 to 0.49—a milestone for compute ecosystem diversity.
Read more →
·4 min
AMD Ryzen AI Halo Hands-On: Can x86 Architecture Challenge NVIDIA's DGX Spark?
In-depth review of the AMD Ryzen AI Halo mini AI box: powered by the Ryzen AI Max Plus 395 (Strix Halo) chip with 128GB unified memory, priced at $4,000. Compared against NVIDIA's DGX Spark across token generation, prefill speed, and x86 advantages.
Read more →