#GPU kernel development

146 related articles

Jul 30, 2026·3 min

The Open-Weight Model Alliance: The Dual Game of AI Safety and American Competitiveness

Analysis of how the open-weight model alliance serves both digital safety and U.S. competitiveness, exploring transparency, ecosystem building, and geopolitical AI competition.

Jul 30, 2026·3 min

GPT-5.6 Autonomously Optimizes Its Own Kernels: How AI Recursive Self-Improvement Could Cut Service Costs by 20%

OpenAI's internal model GPT-5.6 reportedly autonomously rewrote production compute kernels, achieving ~20% cost reduction. Deep analysis of this AI recursive self-optimization event's technical plausibility, industry impact, and key questions.

Jul 29, 2026·3 min

Is LLM Inference Actually Profitable? Breaking Down the Cost Structure and Business Logic of Large Model Inference

A deep dive into LLM inference cost structure and profitability models—from GPU throughput, MoE architecture, and KV Cache to scale effects—revealing the business logic behind API price wars.

Jul 29, 2026·3 min

Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention

Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.

Jul 29, 2026·3 min

Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention

Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.

Jul 29, 2026·3 min

GitHub Daily · July 29: Voice AI and On-Device Training Take Flight as Open-Source Alternatives Rise

GitHub Trending July 29: Microsoft's VibeVoice leads voice AI open-source wave, MoonshotAI's FlashKDA CUDA kernel surges 25%, and open-source alternatives rise.

Jul 28, 2026·3 min

Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention

A deep dive into Kimi Delta Attention (KDA): tracing the evolution from quadratic Softmax attention through linear attention, Delta rules, and gated decay mechanisms, with insights on associative memory and hardware optimization.

Jul 28, 2026·3 min

Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention

Deep dive into Kimi Delta Attention (KDA): from standard Softmax attention's quadratic bottleneck through linear attention, Delta Rule, and gated decay mechanisms — the complete evolution explained.

Jul 28, 2026·4 min

Kimi K3 Deep Dive: 2.8 Trillion Parameter Open-Source Model Closes the Gap with Closed-Source Frontier for the First Time

Moonshot AI releases Kimi K3 open-weight model with 2.8T parameters and 1M token context. Our deep dive covers coding, 3D dev, agent capabilities, and safety concerns.

Jul 28, 2026·3 min

Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA

Deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on RTX 5080. Exploring its architecture, Metal porting plans, and applications in VTuber, AR/VR, and sports analysis.

Jul 28, 2026·3 min

Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA

A deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on an RTX 5080.

Jul 27, 2026·4 min

Jensen Huang Joins 50 Silicon Valley Giants to Champion Open-Source Models: How Capital Logic Overrides Political Correctness

Jensen Huang's first-ever tweet backs open-weight AI. 50 Silicon Valley giants oppose banning Chinese open-source models. Deep analysis of the interests behind closed vs. open AI ecosystems.

Jul 27, 2026·7 min

DIY Companion Robot: Building Your AI Desktop Buddy with Jetson Orin

A maker builds a DIY companion robot with NVIDIA Jetson Orin and 4S LiPo battery. Explore the full development journey from first power-up to AI interaction, including edge computing, power design, and companion robot trends.

Jul 26, 2026·3 min

Rust and Mojo Are Quietly Replacing Python's Low-Level Engine

Python tops the language rankings again, but AI teams are quietly swapping its internals for Rust and Mojo. A look at Python's speed and GIL pains, the two-language problem, and the rise of Rust tooling and Mojo on GPUs.

Jul 26, 2026·3 min

DeepSeek-OCR Deployment and Fine-Tuning: A Complete Hands-On Guide

Master the full DeepSeek-OCR deployment and fine-tuning workflow: vLLM inference deployment, efficient Unsloth fine-tuning, dataset preprocessing, LoRA training, validation, and RAG vector database integration.

Jul 25, 2026·5 min

Liang Wenfeng's 4-Hour Internal Talk: DeepSeek's Philosophy of Restraint and Its Path to AGI

DeepSeek founder Liang Wenfeng shares his views on open source, pricing, computing power, and the five-stage roadmap to AGI in a 4-hour internal investor talk.

Jul 25, 2026·3 min

Kimi K3 Shakes the World: Is Open-Source AI Closing the Gap?

Moonshot AI's 2.8T-parameter open-weight model Kimi K3 rivals Anthropic and OpenAI flagships, sparking a new 'DeepSeek moment' and challenging U.S. AI dominance.

Jul 24, 2026·6 min

AI Application Engineer Interview Guide: Core Topics in Model Quantization and Inference Deployment

A systematic review of must-know topics for AI Application Engineer interviews: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.

Jul 24, 2026·6 min

AI Application Engineer Interview Guide: Core Topics on Model Quantization and Inference Deployment

A systematic guide to must-know AI application engineer interview topics: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.

Jul 24, 2026·4 min

Dify Local Deployment Guide: One-Click Private AI Platform with Docker

Step-by-step guide to deploying Dify AI platform locally with Docker. Covers Linux, Windows, macOS setup, docker compose launch, and first-time initialization in under 30 minutes.