#CUDA

380 related articles

Jul 31, 2026·2 min

Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia

Hygon unveils a 512-thread server CPU and AI GPU, directly challenging Intel Xeon and Nvidia. A deep dive into specs, applications, ecosystem challenges, and strategic significance.

Jul 31, 2026·3 min

Practical Guide to Setting Up a Local AI Coding Environment on MacBook Pro M4

Complete guide to setting up a local AI coding environment on MacBook Pro M4, covering Ollama, MLX, Continue, Qwen3-Coder 30B configuration, and performance optimization strategies for 32GB RAM.

Jul 31, 2026·3 min

Thermodynamic Elastic Compiler (TEC): Tackling AI Compute Bloat Through Reversible Computing

Deep analysis of how the Thermodynamic Elastic Compiler (TEC) leverages Landauer's Principle and reversible computing to reduce AI energy consumption by eliminating 99.5% of bit erasures, with applications in edge AI and distributed deployment.

Jul 30, 2026·3 min

No Python Required: A Unified Multimodal Local AI Generation CLI Tool

A CLI tool that enables local text, image, video, music, and 3D generation without Python. Explore its technical approach, advantages, limitations, and the growing trend of local AI tooling.

Jul 30, 2026·3 min

No Python Required: A Unified Multimodal Local AI Generation CLI Tool

A CLI tool requiring no Python that supports local text, image, video, music, and 3D generation. Explore its technical approach, advantages, limitations, and the growing trend of local AI toolification.

Jul 30, 2026·3 min

LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec

Why memory bandwidth (GB/s), not VRAM size, determines local LLM inference speed. Includes tokens/sec formula, GPU bandwidth comparison, and a practical card selection framework.

Jul 30, 2026·3 min

LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec

Learn why memory bandwidth (GB/s)—not VRAM size—determines local LLM inference speed. Get the tokens/sec formula, GPU bandwidth comparisons, and a practical card selection hierarchy.

Jul 30, 2026·3 min

Cloud GPU Platform Selection: A Practical Guide from HuggingFace to Cloud Reproduction

In-depth analysis of five key dimensions for cloud GPU platform selection, covering RunPod, Lambda, Paperspace, Vast.ai, and more to solve environment setup challenges for open-source model reproduction.

Jul 30, 2026·3 min

GPT-5.6 Autonomously Optimizes Its Own Kernels: How AI Recursive Self-Improvement Could Cut Service Costs by 20%

OpenAI's internal model GPT-5.6 reportedly autonomously rewrites production kernels, achieving ~20% service cost reduction. Deep analysis of this AI recursive self-optimization event's technical plausibility and industry impact.

Jul 30, 2026·3 min

GPT-5.6 Autonomously Optimizes Its Own Kernels: How AI Recursive Self-Improvement Could Cut Service Costs by 20%

OpenAI's internal model GPT-5.6 reportedly autonomously rewrote production compute kernels, achieving ~20% cost reduction. Deep analysis of this AI recursive self-optimization event's technical plausibility, industry impact, and key questions.

Jul 29, 2026·3 min

Production-Grade LLM Inference Deployment: A Practical K8s Handbook

Complete guide to deploying production-grade LLM inference on Kubernetes, covering GPU scheduling, vLLM engine selection, autoscaling, observability, and cost optimization.

Jul 29, 2026·3 min

GitHub Daily · July 29: Voice AI and On-Device Training Take Flight as Open-Source Alternatives Rise

GitHub Trending July 29: Microsoft's VibeVoice leads voice AI open-source wave, MoonshotAI's FlashKDA CUDA kernel surges 25%, and open-source alternatives rise.

Jul 29, 2026·4 min

Project Rai-chan Technical Breakdown: A Complete Guide to Building a Fully Local AI Companion

Deep dive into Project Rai-chan's tech stack: Ollama+Gemma local LLM, Unity rendering, VOICEVOX speech synthesis, and more — exploring the technical path for local AI companions.

Jul 29, 2026·4 min

A Guide to Full-Stack Machine Learning Project Repository Structure: From Chaos to Convention

A detailed guide to organizing full-stack ML project repositories, covering directory structure design, data-code separation, and externalized configuration to help ML developers move from experimental code to production-grade engineering standards.

Jul 29, 2026·4 min

Full-Stack Machine Learning Project Repository Structure Guide: From Chaos to Convention

A detailed guide to organizing full-stack ML project repositories, covering directory structure design, data-code separation, and configuration externalization to help ML developers move from experimental code to production-grade engineering.

Jul 28, 2026·3 min

Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention

A deep dive into Kimi Delta Attention (KDA): tracing the evolution from quadratic Softmax attention through linear attention, Delta rules, and gated decay mechanisms, with insights on associative memory and hardware optimization.

Jul 28, 2026·3 min

Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention

Deep dive into Kimi Delta Attention (KDA): from standard Softmax attention's quadratic bottleneck through linear attention, Delta Rule, and gated decay mechanisms — the complete evolution explained.

Jul 28, 2026·3 min

ncnn Vulkan Cross-Platform Edge Inference in Practice: Solving the GPU Fragmentation Deployment Challenge

Facing GPU fragmentation on edge devices, the PostSlate team used ncnn's Vulkan backend for cross-platform ML inference, achieving 10× speedup on RTX 4070 with half the model size and zero runtime installation.

Jul 28, 2026·3 min

Apple Silicon LLM Inference Speed Benchmarks: A Complete Guide to Local Large Model Performance on Mac

In-depth analysis of Apple Silicon local LLM inference speed benchmarks covering M-series memory bandwidth, model quantization, MLX framework optimization, and Mac configuration guidance.

Jul 28, 2026·3 min

AMD CDNA5 Architecture Deep Dive: Technical Evolution and the AI Computing Competition Landscape

Deep analysis of AMD's CDNA5 architecture covering Chiplet packaging upgrades, HBM memory evolution, and low-precision compute optimization, examining how AMD challenges NVIDIA's AI chip dominance.