#throughput

539 related articles

Jul 30, 2026·4 min

SQLite in Production: A Deep Dive into WAL Mode, Concurrency Control, and VFS Optimization

A deep dive into three core SQLite production optimizations: WAL mode for read/write concurrency, single-writer concurrency model best practices, and VFS layer tuning with mmap and custom locking.

Jul 30, 2026·2 min

Behind the Open-Source Model Frenzy: Who Will Provide Cheap Inference Services?

Open-source LLM weights don't equal low-cost access for developers. This article analyzes the inference service gap in open-source AI and how providers like Together AI and Groq are addressing it.

Jul 30, 2026·2 min

Behind the Open-Source Model Frenzy: Who Will Provide Cheap Inference Services?

Open-source LLM weights don't mean developers can use them cheaply. This article examines the inference service gap in open-source AI and how providers like Together AI and Groq are addressing it.

Jul 29, 2026·3 min

Self-Hosting Kimi K3: Is Spending 20% More on Hardware Worth a 20% Improvement in Task Performance?

Analysis of whether spending 20% more on hardware for self-hosting Kimi K3 to gain 20% task performance improvement is worthwhile, covering inference precision, VRAM optimization, and tiered deployment.

Jul 29, 2026·2 min

Real User Feedback: Claude Opus 5 vs Gemini 3.1 Pro — Does Speed Determine the Experience?

A Reddit user's hands-on comparison of Claude Opus 5 vs Gemini 3.1 Pro reveals that response speed and interaction fluidity may matter more than raw intelligence in choosing an LLM.

Jul 29, 2026·3 min

Production-Grade LLM Inference Deployment: A Practical K8s Handbook

Complete guide to deploying production-grade LLM inference on Kubernetes, covering GPU scheduling, vLLM engine selection, autoscaling, observability, and cost optimization.

Jul 29, 2026·2 min

Hunter-Gatherers Were Already Introducing Fish to Alpine Lakes 7,000 Years Ago

Archaeological research reveals hunter-gatherers introduced fish to alpine lakes 7,000 years ago, challenging assumptions that human environmental modification began with agriculture.

Jul 29, 2026·3 min

Is LLM Inference Actually Profitable? Breaking Down the Cost Structure and Business Logic of Large Model Inference

A deep dive into LLM inference cost structure and profitability models—from GPU throughput, MoE architecture, and KV Cache to scale effects—revealing the business logic behind API price wars.

Jul 29, 2026·3 min

Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention

Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.

Jul 29, 2026·3 min

Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention

Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.

Jul 29, 2026·3 min

GitHub Daily · July 29: Voice AI and On-Device Training Take Flight as Open-Source Alternatives Rise

GitHub Trending July 29: Microsoft's VibeVoice leads voice AI open-source wave, MoonshotAI's FlashKDA CUDA kernel surges 25%, and open-source alternatives rise.

Jul 29, 2026·3 min

Ollama API Key Proxy: Multi-Key Rotation to Solve Rate Limiting Issues

Learn how Ollama API Key Proxy solves cloud LLM rate limiting through reverse proxy with round-robin key rotation, 429 auto-cooldown, and smart retry logic.

Jul 29, 2026·3 min

Google's $1 Billion Dark Fiber Deal with Verizon: AI Infrastructure Competition Goes Deep

Google signs a $1B+ dark fiber deal with Verizon to interconnect data centers for AI training and inference. Verizon launches AI Connect, converting central offices into edge compute nodes.

Jul 28, 2026·3 min

Gemini 2.5 Flash Deprecation: A Practical Migration Guide for Image Understanding Models

Gemini 2.5 Flash will be deprecated in October 2026. Learn how to choose between gemini-3.1-flash-lite and gemini-3.5-flash-lite for image understanding tasks with migration evaluation methods and architecture tips.

Jul 28, 2026·3 min

ChatGPT as Your Home Tech Advisor: How It Helped Me Save $20 a Month

A Reddit user used ChatGPT to diagnose home network issues, discovered the bottleneck was the router not the ISP, and saved $20/month by downgrading their plan. Learn the AI collaboration method.

Jul 28, 2026·3 min

Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention

A deep dive into Kimi Delta Attention (KDA): tracing the evolution from quadratic Softmax attention through linear attention, Delta rules, and gated decay mechanisms, with insights on associative memory and hardware optimization.

Jul 28, 2026·3 min

Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention

Deep dive into Kimi Delta Attention (KDA): from standard Softmax attention's quadratic bottleneck through linear attention, Delta Rule, and gated decay mechanisms — the complete evolution explained.

Jul 28, 2026·2 min

Gemini 3.6 Flash Hands-On: Upgrades in Both Quality and Token Efficiency

In-depth analysis of Google Gemini 3.6 Flash's core upgrades including output quality improvements and token consumption optimization, with developer migration advice.

Jul 28, 2026·2 min

Gemini 3.5 Flash Cyber: Google's Lightweight Model Built for Cybersecurity

Google launches Gemini 3.5 Flash Cyber, a lightweight AI model built for cybersecurity teams focused on proactive vulnerability discovery and patching before exploitation.

Jul 28, 2026·4 min

150,000 Flights in a Single Day Sets Global Record: Deep Dive into Data Tracking and Airspace Challenges

Global airlines operated over 150,000 flights in a single day, setting a civil aviation record. This article analyzes the drivers, ADS-B tracking technology, high-density airspace challenges, and AI applications in air traffic optimization.