#CUDA optimization
247 related articles
·4 min
Redesigning Graphics APIs: Doing More with Less for Modern GPUs
Exploring the possibility of designing a modern graphics API from scratch, analyzing the sources of complexity in Vulkan and DirectX 12, and discussing how to better balance ease of use with GPU performance.
Read more →
·5 min
Building a Neural Network from Scratch with NumPy: A Complete Hands-On Guide
Learn how to build a neural network from scratch using only Python and NumPy, covering forward propagation, backpropagation, gradient descent with full code walkthrough and learning resources.
Read more →
·2 min
Got a GPU Cluster but Don't Know What to Do? A Practical Guide to Choosing AI Projects
Facing GPU cluster resources as an AI beginner? This guide covers project ideas from AI safety to model evaluation to RAG optimization, helping students effectively leverage compute resources.
Read more →
·3 min
Software Optimization Makes a Single B200 Rival Dedicated Inference Chips
Analysis of how a single NVIDIA B200 GPU surpasses Groq LPU and approaches Cerebras performance through software optimization alone, covering CUDA kernels, TensorRT-LLM, and FP8 quantization.
Read more →
·3 min
ComfyUI Integration with MiniMax H3: Complete Video Generation Workflow Deployment and Optimization Guide
Complete guide to deploying MiniMax H3 video generation in ComfyUI, covering text-to-video, image-to-video, first/last frame animation, environment setup, VRAM optimization, and prompt techniques.
Read more →
·4 min
Quantization Illustrated: A Deep Dive into Core Compression Techniques for Large Language Models
A deep dive into LLM quantization techniques covering symmetric/asymmetric quantization, PTQ, QAT, GPTQ, AWQ, and outlier solutions for efficient model deployment.
Read more →
·2 min
AMD Acquires Taalas: What Does Etching AI Models Into Silicon Mean?
AMD acquires chip startup Taalas to etch AI models directly into silicon for extreme inference efficiency. We analyze the technology, tradeoffs, and AMD's differentiated AI strategy.
Read more →
·3 min
Open-Source vs Closed-Source Models, Reward Hacking & Benchmark Gaming: A Deep Dive into Core AI Model Technical Issues
Deep analysis of six core AI model issues: open-source vs closed-source models, inference throughput vs accuracy tradeoffs, benchmark gaming, distillation vs RL, reward hacking defenses, and dynamic quantization technology.
Read more →
·2 min
Local GPU or Cloud for Machine Learning? A Purchasing Decision Guide
Should ML beginners buy a local GPU laptop or use cloud computing? This guide analyzes cloud platforms like Colab and Kaggle vs. gaming laptops, offering budget-friendly recommendations and hybrid strategies.
Read more →
·2 min
Getting Started with Local AI Model Deployment: A Complete Guide from Downloading on Hugging Face to Running with llama.cpp
A beginner-friendly guide to local AI model deployment, covering secure model downloads from Hugging Face, running inference, exporting to GGUF format, and high-performance local execution with llama.cpp.
Read more →
·3 min
Unsloth Now Supports AMD GPUs: 2x Training Speedup and 70% VRAM Savings Across 500+ Models
Unsloth officially supports AMD GPUs across RDNA 3-4, Strix Halo, and MI300 series, delivering 2x training speedup and 70% VRAM savings on 500+ models with RL and vLLM weight sharing support.
Read more →
·3 min
persistent-inference: Solving TF/Keras Cold Start Problems with Just Two Files
Deep dive into the persistent-inference open-source project: solve TF/Keras cold start problems with just two files by keeping models resident in memory, eliminating reload overhead.
Read more →
·3 min
Cursor Agent vs Codex: Which Should Visual AI Developers Choose?
In-depth comparison of Cursor Agent Window vs OpenAI Codex for Vision AI development, analyzing large task handling, multi-file edits, debugging, and long-running tasks to help developers decide.
Read more →
·3 min
The Real Efficiency Bottlenecks for AI Developers: It's Not the GPU — It's These Overlooked Areas
AI developers often think a bigger GPU will boost efficiency, but the real bottlenecks are often RAM, storage, networking, and workflow. Discover the overlooked upgrades that deliver the highest ROI.
Read more →
·4 min
SAM 3 Auto-Labeling in Practice: Six Lessons Where Preprocessing Matters More Than the Model
Practical lessons from building a SAM 3 auto-labeling pipeline: vision embedding reuse, resolution handling, prompt engineering, threshold sweeping, and more.
Read more →
·3 min
Walk on Decomposed Subdomains: A Mesh-Free Approach to Accelerating Monte Carlo PDE Solvers
Deep dive into Walk on Decomposed Subdomains, exploring how subdomain decomposition accelerates Monte Carlo PDE solving and improves WoS convergence in complex geometries.
Read more →
·2 min
antirez Strikes Again: ds4, a Pure C Local Inference Engine for DeepSeek 4
Redis creator antirez open-sources ds4, a pure C local inference engine for DeepSeek 4 Flash and PRO with native Metal, CUDA, and ROCm support, earning nearly 20K GitHub stars.
Read more →
·3 min
Locally Deploying LLMs for Trading Bots: Hardware Selection & Model Recommendations
How to deploy LLMs locally on AMD RX 7800 XT 16GB for trading bots: ROCm ecosystem, 7B-14B model picks (Qwen2.5, Llama 3.1), Ollama/LM Studio setup, and system architecture design.
Read more →
·4 min
SELENE Open-Source Project: An Interactive Notebook Library for Systematically Learning AI and Machine Learning from Scratch
SELENE is an open-source AI learning resource built on Jupyter Notebooks, systematically covering ML, deep learning, Transformers, and LLMs with interactive code and math derivations for beginners.
Read more →
·3 min
MI355X Running Kimi K3 Benchmark: The Logic Behind Outperforming B300 in Performance per Dollar
Deep analysis of AMD MI355X running Kimi K3 with superior cost-efficiency vs NVIDIA B300, and its implications for the AI inference hardware market.
Read more →