#CUDA kernel generation
117 related articles
·3 min
Huawei HDC Deep Dive: Pangu 2.0 Goes Open Source and HarmonyOS 7 Agents Reshape the Mobile AI Ecosystem
Huawei HDC unveils Pangu 2.0 full open source and HarmonyOS 7 system-level Agent capabilities. Deep analysis of sparse architecture efficiency, on-device 30B models, and the Agent gateway battle.
Read more →
·3 min
Xiaomi MIMO vs. Huawei Pangu AI Strategy Comparison: The Android vs. iOS Battle of the Agent Era
Xiaomi releases open-source MIMO Code while Huawei enters the Agent era with Pangu. Compare their AI strategies: Xiaomi's Android-like open ecosystem vs. Huawei's iOS-like vertical integration.
Read more →
·3 min
LFM2.5 Local Deployment Hands-On: An 8B Parameter Model That Outperforms GPT-o3s in Tool Calling
Hands-on test of Liquid AI's LFM2.5 local deployment: architecture breakdown, 16GB VRAM troubleshooting, and GraphRAG tool-calling benchmarks vs GPT-o3s.
Read more →
·4 min
Getting Started with Huawei Ascend C Operator Programming: Kernel Functions and Hands-On Development Guide
A systematic guide to Huawei Ascend C operator programming covering kernel functions, three-stage pipeline paradigm, API categories, and a hands-on AddCustom operator walkthrough.
Read more →
·3 min
vLLM Deep Dive: How PagedAttention Enables High-Throughput LLM Inference
Deep dive into vLLM's core technologies for high-throughput LLM inference, including PagedAttention memory management, continuous batching, distributed deployment, and comparisons with TensorRT-LLM.
Read more →
Expert Opinions·3 min
Windsurf CEO Deep Dive Interview: Speed Is the Only Moat
Windsurf CEO Varun Mohan shares insights on AI coding IDE pivots, product methodology, async Agent challenges, and differentiation strategy vs Cursor. Speed is the only moat.
Read more →
Tutorials·3 min
llama.cpp MTP Acceleration Deployment Guide: Configuration Steps & Real-World Benchmarks
Guide to enabling MTP multi-Token prediction acceleration in llama.cpp, covering CUDA setup, desktop configuration, model selection, and benchmarks showing ~60 Token/s with Qwen3 27B.
Read more →
Tutorials·4 min
Practical Guide to Building a Local AI Knowledge Base with Qwen3.5 + RAGFlow + Ollama
Step-by-step guide to building a local RAG knowledge base using RAGFlow, Ollama, and LM Studio with Docker, covering Embedding model deployment and network troubleshooting for private AI Q&A.
Read more →
Research·2 min
Agent Loops in Practice: Transforming Token Output into Productivity from CUDA Kernels to Automated Research
Deep dive into how the Humanize framework transforms LLM tokens into engineering productivity via Agent Loops. Covers KDA winning CUDA kernel contests, virtual hardware optimization, and 50% research cost reduction.
Read more →
Tech Frontiers·2 min
SGLang v0.5.12.post1 Released: DeepSeek V4 Stability Fixes and Blackwell Adaptation
SGLang v0.5.12.post1 stability patch details: 12 critical fixes covering DeepSeek V4 garbled text and crashes, NIXL PD disaggregated inference logic, Blackwell B300 adaptation, and cold start optimization.
Read more →
Industry Insights·2 min
AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference
AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.
Read more →
Research·2 min
Optimize Anything: One API to Unify Optimization of Code, Prompts, and Agent Architectures
UC Berkeley and Stanford propose Optimize Anything, a universal text optimization framework that unifies optimization of CUDA kernels, agent architectures, and prompts through one declarative API.
Read more →
Tutorials·3 min
PyTorch Beginner Tutorial: A Complete Guide to Tensor Operations and Neural Network Construction
A detailed PyTorch beginner guide covering tensor operations, dynamic computational graphs, GPU acceleration, and building your first neural network with nn.Module, with learning path recommendations and code examples.
Read more →
Industry Insights·2 min
In-Depth Analysis of C++ + AI Full-Stack Training Programs: Career Transition Paths for Developers in 2026
An in-depth analysis of C++ + AI full-stack training programs covering CUDA, YOLO, RAG, and interest-aligned employment guarantees for C++ developers transitioning to AI roles.
Read more →
Tutorials·2 min
Hermes + Qwen3.6 Local Deployment Tutorial: Build Your Private AI Agent at Zero Cost
Step-by-step tutorial to deploy Hermes Agent with Qwen3.6 open-source LLM locally. Covers WSL setup, model download, Telegram bot integration for a zero-cost private AI Agent.
Read more →
Tutorials·2 min
vLLM and SGLang Local Deployment Tutorial: A Practical Guide to 3-8x Performance Gains
Complete guide to deploying vLLM and SGLang locally. Compare performance vs LM Studio, deploy in 3 steps with Docker + AI assistant. Covers SGLang vs vLLM selection, 5090 VRAM optimization, and Cherry Studio integration.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →
Tech Frontiers·3 min
Mistral AI Teams Up with NVIDIA to Build Open-Source AI Models — How Will This Partnership Reshape the Industry?
Mistral AI and NVIDIA announce a strategic partnership to co-develop frontier open-source AI models. A deep analysis of the collaboration's background, technical synergies, and impact on the open vs. closed source AI landscape.
Read more →
Tech Frontiers·3 min
NVIDIA Nemotron Hackathon Korea Winners Announced: Asia-Pacific AI Developers Showcase Their Strength
NVIDIA Nemotron Hackathon Korea winners officially announced, showcasing Korean AI developer innovation. Analysis of Nemotron LLM ecosystem, Korea's AI landscape, and NVIDIA's global developer strategy.
Read more →
Deep Dives·3 min
Microsoft Tutel: A Deep Dive into the MoE Model Acceleration Library with FP4/FP8 Low-Precision Support
A deep dive into Microsoft's open-source Tutel MoE optimization library, supporting FP8, NVFP4, and MXFP4 multi-precision computation for DeepSeek, Kimi-K2, Qwen3, and other leading MoE models.
Read more →