#GPU performance optimization

661 related articles

Jul 29, 2026·3 min

Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention

Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.

Jul 29, 2026·3 min

Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention

Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.

Jul 29, 2026·2 min

Reverse Engineering Apple's ANE: Open-Source Project Enables On-Device Training on the Neural Engine

Deep dive into the maderix/ANE GitHub project that reverse engineers Apple's private APIs to enable neural network training on the Apple Neural Engine, exploring its technical approach, efficiency gains, compliance risks, and implications for on-device AI.

Jul 29, 2026·3 min

GitHub Daily · July 29: Voice AI and On-Device Training Take Flight as Open-Source Alternatives Rise

GitHub Trending July 29: Microsoft's VibeVoice leads voice AI open-source wave, MoonshotAI's FlashKDA CUDA kernel surges 25%, and open-source alternatives rise.

Jul 29, 2026·3 min

Google's $1 Billion Dark Fiber Deal with Verizon: AI Infrastructure Competition Goes Deep

Google signs a $1B+ dark fiber deal with Verizon to interconnect data centers for AI training and inference. Verizon launches AI Connect, converting central offices into edge compute nodes.

Jul 29, 2026·2 min

Grok 4.6 and 4.7 Roadmap Leaked: Analyzing xAI's Rapid Iteration Strategy

Reddit leaks suggest Grok 4.6 arrives around August 7 and Grok 4.7 in early September. This article analyzes xAI's rapid iteration strategy and token efficiency improvements.

Jul 29, 2026·2 min

Running Manim in the Browser: Rebuilding 3Blue1Brown's Animation Engine with WebGPU

Explore how WebGPU brings 3Blue1Brown's Manim math animation engine to the browser, enabling zero-install, real-time mathematical visualization with interactive education potential.

Jul 28, 2026·2 min

Training AI to Play Devil May Cry 3 with Reinforcement Learning: Challenges and Practices in Action Game AI

An indie developer trains AI to autonomously play Devil May Cry 3 using reinforcement learning. Explore the core challenges of action game AI including sparse rewards, high-dimensional action spaces, and real-time decision-making.

Jul 28, 2026·2 min

Training AI to Play Devil May Cry 3 with Reinforcement Learning: Challenges and Practices for Action Game AI

An indie developer trains AI to autonomously play Devil May Cry 3 using reinforcement learning. This article analyzes the core challenges including sparse rewards, high-dimensional action spaces, and real-time decision-making.

Jul 28, 2026·2 min

Google Invests $40 Million in AI Tokens to Power the U.S. Department of Energy's Genesis Mission

Google commits $40M in AI tokens and Google Cloud credits to the DOE's Genesis Mission, deploying Gemini AI models to help lab researchers accelerate scientific discovery over the next decade.

Jul 28, 2026·1 min

AI Model Iteration Accelerates: Has GPT-5 Already Been Surpassed by Smaller Models? The Rise of Open Source

Exploring the accelerating AI model iteration trend: open-source models like Qwen3.6 27B rival GPT-5 in benchmarks. Analysis of the technical reasons, open-source rise, and future competition.

Jul 28, 2026·1 min

AI Model Iteration Accelerates: Has GPT-5 Already Been Surpassed by Smaller Models? The Rise of Open Source

Exploring the accelerating AI model iteration trend: open-source models like Qwen3.6 27B rival GPT-5 in benchmarks. Analysis of the technical reasons, open-source rise, and future implications.

Jul 28, 2026·3 min

ncnn Vulkan Cross-Platform Edge Inference in Practice: Solving the GPU Fragmentation Deployment Challenge

Facing GPU fragmentation on edge devices, the PostSlate team used ncnn's Vulkan backend for cross-platform ML inference, achieving 10× speedup on RTX 4070 with half the model size and zero runtime installation.

Jul 28, 2026·2 min

HuggingFace Open-Source Voice Assistant: A Complete Guide to Local Deployment

A deep dive into HuggingFace's speech-to-speech open-source project, covering its modular VAD, STT, LLM, and TTS pipeline architecture and the advantages of local deployment for privacy, cost, and latency.

Jul 28, 2026·3 min

Gemini Batch API Major Upgrade: 80% Latency Reduction, Success Rate Exceeds 99.998%

Google's Gemini Batch API completes major infrastructure upgrade with 80% lower p95 latency, 99.998%+ success rate, 98% fewer expirations, and new partial batch support for large-scale AI inference.

Jul 28, 2026·3 min

Kimi K3 vs Claude Real-World Test: Near-Equal Performance at 1/8 the Price

Real-world comparison of Kimi K3 vs Claude flagship across e-commerce pages, 3D fighting games, and flight simulators. Kimi K3 delivers 90% output quality at 1/8 the price with faster speeds and local deployment support.

Jul 28, 2026·3 min

Kimi K3 Hands-On Review: 2.5 Trillion Parameter Open-Source Model Takes on Claude

Hands-on review of Kimi K3, Moonshot AI's latest 2.5T parameter MoE model. Coding ability ties with Claude, surpasses it in 3D game dev, with API pricing at one-tenth of competitors.

Jul 28, 2026·3 min

Kimi K3 Launch: A 2.8 Trillion Parameter Flagship Model Makes Its Grand Entrance

Moonshot AI launches Kimi K3 with 2.8 trillion parameters and 1M token context. Google delays Gemini 3.5 Pro, AI coding tools upgrade collectively as competition shifts to coding and Agent capabilities.

Jul 28, 2026·3 min

Kimi K3 Open-Source Release: 2.8 Trillion Parameters Tops Global Programming Leaderboard

Moonshot AI's Kimi K3 launches with 2.8 trillion parameters, tops LMArena frontend coding leaderboard as world #1, completing tasks at one-third competitors' cost. Fully open-source for commercial use.

Jul 28, 2026·5 min

July 24 AI Daily Brief: Flux 3 Multimodal Release, Kimi K3 Lags in Testing, Qwen Tops TTS Rankings

July 24 AI news: Black Forest Labs launches Flux 3 multimodal model, Kimi K3 lags in US-UK gov tests, Alibaba Qwen tops TTS rankings, Etched raises $300M, AMD unveils MI430X.