#AMD GPU
143 related articles
·3 min
DeepSeek-V4 Flash RL Training Successfully Ported to AMD MI355X GPU: A Complete Breakdown
The Miles team and AMD announce the full port of DeepSeek-V4 Flash RL training to AMD Instinct MI355X GPUs on ROCm, boosting AIME pass@1 from 0.39 to 0.49—a milestone for compute ecosystem diversity.
Read more →
·3 min
Running Local LLMs on AMD GPUs: Ditching Ollama for LM Studio Delivers 7x Speed Boost
AMD GPU black screens running local LLMs? This post-mortem covers Ollama's 3 fatal flaws and how switching to LM Studio boosted token speed from 5 to 36, with ROCm setup, Speculative Decoding, and GFX version tips.
Read more →
Tutorials·2 min
Tutorial: Deploying a PD-Disaggregated SGLang Multi-Node Inference Cluster on AMD GPUs
Learn how to deploy a PD-disaggregated SGLang inference cluster on AMD GPUs using a single config file, boosting LLM throughput and latency performance.
Read more →
Tech Frontiers·2 min
AMD FSR 4.1 Coming to Older GPUs: RDNA 2/3 Upgrade Timeline & Technical Breakdown
AMD confirms FSR 4.1 super resolution coming to older GPUs: RDNA 3 (RX 7000) in July 2025, RDNA 2 (RX 6000) in early 2027. Full technical breakdown and competitive analysis.
Read more →
·2 min
antirez Strikes Again: ds4, a Pure C Local Inference Engine for DeepSeek 4
Redis creator antirez open-sources ds4, a pure C local inference engine for DeepSeek 4 Flash and PRO with native Metal, CUDA, and ROCm support, earning nearly 20K GitHub stars.
Read more →
·2 min
MiniMax H3 Local AI Video Generation: Deployment Methods, Hardware Requirements & Hands-On Analysis
In-depth analysis of MiniMax H3 local video generation capabilities, exploring hardware requirements, advantages, challenges, and the trend of AI video moving from cloud to local deployment.
Read more →
·3 min
Locally Deploying LLMs for Trading Bots: Hardware Selection & Model Recommendations
How to deploy LLMs locally on AMD RX 7800 XT 16GB for trading bots: ROCm ecosystem, 7B-14B model picks (Qwen2.5, Llama 3.1), Ollama/LM Studio setup, and system architecture design.
Read more →
·3 min
Running the 1.56TB Kimi K3 Model on 8GB RAM with Pure C
A developer built a pure C99 inference engine that runs the 1.56TB Kimi K3 model on 8GB RAM using MoE sparsity and NVMe on-demand loading—no GPU, 176KB binary.
Read more →
·3 min
MI355X Running Kimi K3 Benchmark: The Logic Behind Outperforming B300 in Performance per Dollar
Deep analysis of AMD MI355X running Kimi K3 with superior cost-efficiency vs NVIDIA B300, and its implications for the AI inference hardware market.
Read more →
·4 min
Multi-Purpose Home Server Build Guide: Streaming + AI Inference + App Hosting on One Machine
How to build a $500 multi-purpose home server for Jellyfin streaming, Ollama local AI inference, web app hosting, and Pi-hole ad blocking with dual RTX 3060 GPUs.
Read more →
·3 min
The Return of Private Cloud: A Rational Choice in the Era of Data Sovereignty and Compute Autonomy
After a decade of public cloud dominance, private cloud is making a comeback. From cost recalculation and data sovereignty compliance to AI compute autonomy, we analyze why enterprises are reconsidering private and hybrid cloud strategies.
Read more →
·3 min
You Don't Always Need a Vector Database for Vector Search — Brute Force Might Be All You Need
In-depth analysis of when brute force vector search beats vector databases. For RAG apps with under a few hundred thousand vectors, brute force offers exact recall, simpler architecture, and easier debugging.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, challenging Intel Xeon and Nvidia. Analysis of specs, applications, ecosystem challenges, and strategic significance.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, directly challenging Intel Xeon and Nvidia. A deep dive into specs, applications, ecosystem challenges, and strategic significance.
Read more →
·3 min
OpenWorker: A Free, Open-Source Local AI Agent That Keeps Your Data at Home
OpenWorker is a free, open-source desktop AI agent that runs locally, supports bring-your-own-model, and keeps your data private. Learn about its local-first design philosophy and key differentiators.
Read more →
·3 min
OpenWorker: A Free, Open-Source Local AI Agent That Keeps Your Data at Home
OpenWorker is a free, open-source desktop AI agent that runs locally, supports bring-your-own-model, and keeps your data private. Learn about its design philosophy and key differentiators.
Read more →
·2 min
AI Bubble Fears Intensify: The Logic Behind Chip Stocks Selling Off Across U.S. and Asian Markets
Chip stocks fall simultaneously across U.S. and Asian markets as AI bubble fears intensify. Analysis of the drivers, sustainability of AI capex, and the balance between short-term volatility and long-term trends.
Read more →
·2 min
AI Bubble Fears Intensify: The Logic Behind Chip Stocks Selling Off Across US and Asian Markets
Chip stocks decline simultaneously across US and Asian markets as AI bubble fears intensify. Analysis of the logic behind the selloff, sustainability questions around AI capex, and the relationship between short-term volatility and long-term trends.
Read more →
·3 min
ncnn Vulkan Cross-Platform Edge Inference in Practice: Solving the GPU Fragmentation Deployment Challenge
Facing GPU fragmentation on edge devices, the PostSlate team used ncnn's Vulkan backend for cross-platform ML inference, achieving 10× speedup on RTX 4070 with half the model size and zero runtime installation.
Read more →
·5 min
July 24 AI Daily Brief: Flux 3 Multimodal Release, Kimi K3 Lags in Testing, Qwen Tops TTS Rankings
July 24 AI news: Black Forest Labs launches Flux 3 multimodal model, Kimi K3 lags in US-UK gov tests, Alibaba Qwen tops TTS rankings, Etched raises $300M, AMD unveils MI430X.
Read more →