#million-token LLM
107 related articles
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.
Read more →
·6 min
Harness Engineering: From Context Engineering to the Third Phase of AI Programming
Explore Harness Engineering: the next evolution beyond context engineering for AI programming. Learn how to build enterprise-grade Skill systems and deliver real projects with mid-tier models.
Read more →
·4 min
Colibri: Running a 744-Billion-Parameter LLM on an Ordinary Laptop
Colibri uses MoE hot-cold separation and 4-bit quantization to run 744B-parameter models like GLM 5.2 on consumer hardware. Learn about its three-tier memory architecture and speculative decoding.
Read more →
·3 min
Anthropic Opus 5 Real-World Testing: Outperforms Competitors at Half the Price
Anthropic Opus 5 hands-on review: first to break 30% on ARC-AGI, near Fable 5 agentic coding at half the price. Benchmarks, token costs, and GPT-5.6 comparison.
Read more →
·3 min
Anthropic Opus 5 Real-World Testing: Outperforms Competitors at Half the Price
Anthropic Opus 5 hands-on review: first to break 30% on ARC-AGI, near Fable 5 in agentic coding at half the price. Benchmarks, token costs, and GPT-5.6 comparison.
Read more →
·4 min
Kimi K3 Deep Dive: 2.8 Trillion Parameter Open-Source Model Closes the Gap with Closed-Source Frontier for the First Time
Moonshot AI releases Kimi K3 open-weight model with 2.8T parameters and 1M token context. Our deep dive covers coding, 3D dev, agent capabilities, and safety concerns.
Read more →
·3 min
Deep Dive into the Kimi-K3 Technical Report: Architecture, Long Context, and Reasoning Capabilities
Deep analysis of Moonshot AI's Kimi-K3 technical report covering long context processing, MoE architecture, reasoning capabilities, and China's position in the global AI competition.
Read more →
·3 min
Deep Dive into the Kimi-K3 Technical Report: A Comprehensive Analysis of Architecture, Long-Context Processing, and Reasoning Capabilities
Deep dive into Moonshot AI's Kimi-K3 technical report, analyzing its long-context processing, MoE architecture, reasoning improvements, and its position in global AI competition.
Read more →
·4 min
Gemini 3.5 Checkpoint Leaked: Intermediate Version Reportedly Outperforms Opus 5 in Testing
Reddit leaks suggest a Google Gemini 3.5 intermediate checkpoint outperformed Claude Opus 5 max thinking in testing. We analyze what checkpoints mean, benchmark credibility, and the LLM competition landscape.
Read more →
·3 min
Laguna S 2.1: The Open-Source Coding Model That's 14x Smaller Yet Stronger
Poolside releases Laguna S 2.1, an open-source agentic coding model: 118B total params with only 8B active, scoring 40.4% on DeepSWE — ~4.5x DeepSeek V4 Pro Max. Supports 1M-token context, deployable on a single workstation.
Read more →
·3 min
Grok 4.5 Review: A Full Breakdown of Elon Musk's Most Powerful AI Coding Model
xAI releases Grok 4.5, ranking #1 on SWE Marathon and outperforming Claude Opus. Explore benchmark scores, Agent capabilities, free access, and CLI installation.
Read more →
·3 min
Qwen3.8 Deep Dive: How Does a 2.4 Trillion Parameter MoE Model Claim Second Place?
Alibaba's Qwen3.8 challenges larger models with a 2.4T-parameter MoE architecture, claiming second only to Gemini. A deep dive into MoE mechanics, continuous updates, two-speed release strategy, and real local deployment requirements.
Read more →
WrenAI: An Open-Source GenBI Tool for …
·4 min
WrenAI: An Open-Source GenBI Tool for Querying Databases with Natural Language
WrenAI is an open-source GenBI tool by the Canner team that converts natural language into trusted SQL, charts, and dashboards via a semantic layer. Supports 20+ data sources including BigQuery and Snowflake. 16,000+ GitHub stars.
Read more →
·5 min
The Complete Claude Code Guide: Installation, Core Features, and Advanced Workflows
An in-depth guide to Anthropic's Claude Code agentic coding tool, covering installation, pricing plans, model selection, token management, CLAUDE.md global memory, MCP integration, Subagents, and more.
Read more →
·3 min
Kimi K3 Hands-On: How a 2.8-Trillion-Parameter Open-Source Model Beat Fable5
A US engineer's live test of Kimi K3: 2.8T parameters, 1M token context, 87% audience vote over Fable5 in game generation. Full report covering benchmarks, speed, and code debugging.
Read more →
·5 min
Advanced Claude Code in Practice: Building a Top-Tier AI Development Workflow
In-depth analysis of Claude Code customization methodology: from access, knowledge injection to tooling. Master context window management, zero-overhead Hooks, and MCP & Skills plugin primitives to build a scalable AI software engineering workflow.
Read more →
·2 min
Zhipu GLM New Model Coming Soon: Decoding the Founder's Teaser
Zhipu AI's Z.ai founder teases a new GLM model just one month after GLM 5.2. We decode the announcement, explore likely upgrade directions, and analyze China's LLM iteration pace.
Read more →
·4 min
MiniMax M2 Local AI Knowledge Base Test: Source Tracing, Deduplication, and Fact Verification
Build a local AI knowledge base with MiniMax M2 in OpenCode: source tracing, fact vs. opinion separation, conflict preservation, and timeliness management.
Read more →
·2 min
GLM Open-Source Model: Can a Million-Token Context Window Challenge Claude Code?
GLM open-source LLM claims 1M-token context, local deployment, and coding ability rivaling Claude Code. We break down the three key selling points and evaluate the hype vs. reality.
Read more →