#KV cache optimization

385 related articles

Jul 29, 2026·3 min

Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention

Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.

Jul 28, 2026·3 min

Kimi K3 vs Claude Real-World Test: Near-Equal Performance at 1/8 the Price

Real-world comparison of Kimi K3 vs Claude flagship across e-commerce pages, 3D fighting games, and flight simulators. Kimi K3 delivers 90% output quality at 1/8 the price with faster speeds and local deployment support.

Jul 28, 2026·3 min

Kimi K3 Launch: A 2.8 Trillion Parameter Flagship Model Makes Its Grand Entrance

Moonshot AI launches Kimi K3 with 2.8 trillion parameters and 1M token context. Google delays Gemini 3.5 Pro, AI coding tools upgrade collectively as competition shifts to coding and Agent capabilities.

Jul 28, 2026·3 min

Kimi K3 Open-Source Release: 2.8 Trillion Parameters Tops Global Programming Leaderboard

Moonshot AI's Kimi K3 launches with 2.8 trillion parameters, tops LMArena frontend coding leaderboard as world #1, completing tasks at one-third competitors' cost. Fully open-source for commercial use.

Jul 28, 2026·4 min

Cursor Start India Plan at ₹649/Month: Decoding the Regional Pricing Strategy for AI Coding Tools

Cursor launches its Start plan for India at ₹649/month (~$7.70), featuring Grok 4.5 and Composer Agent. A deep dive into the PPP pricing strategy and its market implications.

Jul 28, 2026·3 min

Deep Dive into Inkling: The First Frontier Open-Source Multimodal LLM from the West

Thinking Machines releases Inkling, an open-source multimodal LLM with near-trillion MoE parameters, 1M token context, Apache 2.0 license. Deep dive into architecture, benchmarks, and pricing.

Jul 28, 2026·4 min

Colibri: Running a 744-Billion-Parameter LLM on an Ordinary Laptop

Colibri uses MoE hot-cold separation and 4-bit quantization to run 744B-parameter models like GLM 5.2 on consumer hardware. Learn about its three-tier memory architecture and speculative decoding.

Jul 28, 2026·4 min

Laguna S 2.1 Deep Dive: Hands-On Local Deployment of a 118B Parameter Coding Model

In-depth review of Poolside's Laguna S 2.1 open-source coding model: MoE architecture, RL training, DGX Spark local deployment, and real-world agentic coding tests with 8B active parameters.

Jul 28, 2026·4 min

GPT-5.6 Value Maxing Practical Guide: From Token Stacking to Output Optimization Methodology

Deep dive into OpenAI GPT-5.6 Value Maxing strategies covering Sol/Terra/Luna model selection, KV cache optimization, Prompt compression, and programmatic tool calling to help developers achieve more output with fewer Tokens.

Jul 28, 2026·4 min

Kimi K3 Deep Dive: 2.8 Trillion Parameter Open-Source Model Closes the Gap with Closed-Source Frontier for the First Time

Moonshot AI releases Kimi K3 open-weight model with 2.8T parameters and 1M token context. Our deep dive covers coding, 3D dev, agent capabilities, and safety concerns.

Jul 28, 2026·4 min

Kimi K2/K3 Technical Speculation: Deep Dive into RL Hyperparameters and Multi-Teacher Distillation

Deep analysis of RL hyperparameter tuning challenges and 9-policy multi-teacher distillation in Kimi K2/K3 training, exploring the shift from scale to training craft.

Jul 28, 2026·2 min

Gemini Always Crashes on the 16th Turn? Error 1076 Root Cause Analysis and Workarounds

Google's Gemini consistently triggers Error 1076 on the 16th conversation turn, regardless of context size. Analysis points to a session state management defect, with three workarounds provided.

Jul 28, 2026·3 min

Apple Silicon LLM Inference Speed Benchmarks: A Complete Guide to Local Large Model Performance on Mac

In-depth analysis of Apple Silicon local LLM inference speed benchmarks covering M-series memory bandwidth, model quantization, MLX framework optimization, and Mac configuration guidance.

Jul 27, 2026·4 min

Choosing the Wrong Agent Ruins Everything: Why the Same Model Can Perform Like Two Completely Different AIs

The same LLM API performs drastically differently under different Agent frameworks. Through a real database crash case, this article analyzes why choosing the right Agent matters more than switching models.

Jul 27, 2026·2 min

DeepSeek V4 Official Release Imminent: What 1.6 Trillion Parameters Really Means

DeepSeek V4 official release is imminent. V4 Pro features 1.6 trillion parameters with million-character context. Explore the D-SPARK acceleration framework, dynamic pricing, and V4's leap to production-grade AI.

Jul 27, 2026·4 min

The Dao of DeepSeek: Liang Wenfeng on Vision, Restraint, and the Philosophy of Open Source

Analysis of DeepSeek founder Liang Wenfeng's rare investor dialogue, exploring the company's vision-driven culture, strategic restraint toward AGI, and open-source philosophy in the US-China AI race.

Jul 27, 2026·3 min

Deep Dive into the Kimi-K3 Technical Report: A Comprehensive Analysis of Architecture, Long-Context Processing, and Reasoning Capabilities

Deep dive into Moonshot AI's Kimi-K3 technical report, analyzing its long-context processing, MoE architecture, reasoning improvements, and its position in global AI competition.

Jul 27, 2026·3 min

Deep Dive into the Kimi-K3 Technical Report: Architecture, Long Context, and Reasoning Capabilities

Deep analysis of Moonshot AI's Kimi-K3 technical report covering long context processing, MoE architecture, reasoning capabilities, and China's position in the global AI competition.

Jul 27, 2026·2 min

Google Flash and Flash-Lite Models Upgraded and Live: A New Lightweight, High-Efficiency AI Option

Google rolls out upgraded 3.6 Flash and 3.5 Flash-Lite models. Learn about the Flash series' positioning, upgrade highlights, and value for developers.

Jul 27, 2026·2 min

Kimi-K3 Lands on HuggingFace: A Full Breakdown of Moonshot AI's Open-Source Strategy

Moonshot AI's Kimi-K3 model is set to launch on HuggingFace. A deep dive into its architecture, licensing, community reactions, and strategic implications for the global open-source AI landscape.