#CUDA
341 related articles
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
A deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on an RTX 5080.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
Deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on RTX 5080. Exploring its architecture, Metal porting plans, and applications in VTuber, AR/VR, and sports analysis.
Read more →
Handwritten C/CUDA Inference Engine: P…
·2 min
Handwritten C/CUDA Inference Engine: Pushing Qwen 35B to the Limits on RTX 5090
A deep dive into a handwritten C/CUDA inference engine for Qwen 35B on RTX 5090 (Blackwell), covering quantization, FlashAttention kernels, and memory optimization.
Read more →
CUDA 13.3 Adds Carryless Multiplicatio…
·2 min
CUDA 13.3 Adds Carryless Multiplication: A Key Step Forward for GPU Cryptography Acceleration
CUDA 13.3 introduces native carryless multiplication support, closing a 15-year GPU gap in AES-GCM, CRC, and cryptographic acceleration. Here's what it means.
Read more →
4 Alternatives for Running CUDA on Non…
·3 min
4 Alternatives for Running CUDA on Non-NVIDIA Hardware: A Comparative Guide
A deep dive into running CUDA on non-NVIDIA hardware (AMD, Intel): comparing ROCm/HIP, ZLUDA, SYCL/oneAPI, and OpenCL across principles, use cases, and limitations.
Read more →
CUDA Kernel Fusion: A Practical Guide …
·2 min
CUDA Kernel Fusion: A Practical Guide to Reducing Memory Bandwidth and Launch Overhead
Learn how CUDA Kernel Fusion merges multiple GPU kernels to reduce global memory traffic and launch overhead, with real-world examples from AI inference and deep learning.
Read more →
·7 min
Reverse-Engineering CUDA-checkpoint: The Technical Principles and Practice of Cracking GPU Cold Starts
An in-depth analysis of reverse-engineering Nvidia CUDA-checkpoint to accelerate GPU cold starts. Covers checkpoint/restore, Serverless GPU prospects, and VRAM snapshot challenges.
Read more →
Research·2 min
Agent Loops in Practice: Transforming Token Output into Productivity from CUDA Kernels to Automated Research
Deep dive into how the Humanize framework transforms LLM tokens into engineering productivity via Agent Loops. Covers KDA winning CUDA kernel contests, virtual hardware optimization, and 50% research cost reduction.
Read more →
Tutorials·1 min
NVIDIA CUDA Tile: A Detailed Look at the New Tile-Based GPU Programming Paradigm
In-depth analysis of NVIDIA's new CUDA Tile programming model: how tile-based GPU kernel development integrates with C++, optimizes data locality, and accelerates Tensor Core computation for HPC, deep learning, and AI inference.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, challenging Intel Xeon and Nvidia. Analysis of specs, applications, ecosystem challenges, and strategic significance.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, directly challenging Intel Xeon and Nvidia. A deep dive into specs, applications, ecosystem challenges, and strategic significance.
Read more →
·3 min
Practical Guide to Setting Up a Local AI Coding Environment on MacBook Pro M4
Complete guide to setting up a local AI coding environment on MacBook Pro M4, covering Ollama, MLX, Continue, Qwen3-Coder 30B configuration, and performance optimization strategies for 32GB RAM.
Read more →
·3 min
Thermodynamic Elastic Compiler (TEC): Tackling AI Compute Bloat Through Reversible Computing
Deep analysis of how the Thermodynamic Elastic Compiler (TEC) leverages Landauer's Principle and reversible computing to reduce AI energy consumption by eliminating 99.5% of bit erasures, with applications in edge AI and distributed deployment.
Read more →
·3 min
No Python Required: A Unified Multimodal Local AI Generation CLI Tool
A CLI tool that enables local text, image, video, music, and 3D generation without Python. Explore its technical approach, advantages, limitations, and the growing trend of local AI tooling.
Read more →
·3 min
No Python Required: A Unified Multimodal Local AI Generation CLI Tool
A CLI tool requiring no Python that supports local text, image, video, music, and 3D generation. Explore its technical approach, advantages, limitations, and the growing trend of local AI toolification.
Read more →
·3 min
LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec
Why memory bandwidth (GB/s), not VRAM size, determines local LLM inference speed. Includes tokens/sec formula, GPU bandwidth comparison, and a practical card selection framework.
Read more →
·3 min
LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec
Learn why memory bandwidth (GB/s)—not VRAM size—determines local LLM inference speed. Get the tokens/sec formula, GPU bandwidth comparisons, and a practical card selection hierarchy.
Read more →
·3 min
Cloud GPU Platform Selection: A Practical Guide from HuggingFace to Cloud Reproduction
In-depth analysis of five key dimensions for cloud GPU platform selection, covering RunPod, Lambda, Paperspace, Vast.ai, and more to solve environment setup challenges for open-source model reproduction.
Read more →