#cold start optimization

157 related articles

Jul 29, 2026·3 min

Production-Grade LLM Inference Deployment: A Practical K8s Handbook

Complete guide to deploying production-grade LLM inference on Kubernetes, covering GPU scheduling, vLLM engine selection, autoscaling, observability, and cost optimization.

Jul 29, 2026·3 min

Is LLM Inference Actually Profitable? Breaking Down the Cost Structure and Business Logic of Large Model Inference

A deep dive into LLM inference cost structure and profitability models—from GPU throughput, MoE architecture, and KV Cache to scale effects—revealing the business logic behind API price wars.

Jul 29, 2026·3 min

Implementing Zanzibar in Lean4: A Formally Verified Permission Engine for AI Projects

Deep dive into a Datalog permission DSL built on Google Zanzibar using Lean4 theorem prover. How formal verification strengthens AI permission management.

Jul 28, 2026·3 min

Gemini Batch API Major Upgrade: 80% Latency Reduction, Success Rate Exceeds 99.998%

Google's Gemini Batch API completes major infrastructure upgrade with 80% lower p95 latency, 99.998%+ success rate, 98% fewer expirations, and new partial batch support for large-scale AI inference.

Jul 28, 2026·5 min

Open-Source STEM Education Robot: Smart Ball-Fetching Interaction Powered by Edge AI Object Detection

An open-source STEM education robot using Edge Impulse edge AI for local object detection, teaching kids computer vision and ML through an engaging ball-fetching game with anthropomorphic design.

Jul 28, 2026·4 min

Colibri: Running a 744-Billion-Parameter LLM on an Ordinary Laptop

Colibri uses MoE hot-cold separation and 4-bit quantization to run 744B-parameter models like GLM 5.2 on consumer hardware. Learn about its three-tier memory architecture and speculative decoding.

Jul 28, 2026·4 min

Deep Dive into the EYG Programming Language: A New Portable Programming Paradigm Designed for Humans

Deep analysis of the EYG programming language's core design, including algebraic effects, program state persistence, and cross-platform portability, exploring how it addresses modern software fragmentation.

Jul 27, 2026·4 min

Self-Contained Portable Python Distributions: Saying Goodbye to Environment Configuration Nightmares

Deep dive into self-contained portable Python distributions: how python-build-standalone uses static linking and path relocation for zero-dependency deployment, and how modern tools like uv leverage this technology.

Jul 27, 2026·2 min

Is Bun Being Rewritten in Rust? A Deep Dive into the Zig vs Rust Technical Decision

Is Bun being rewritten in Rust? This article explores the community debate and analyzes why Bun chose Zig over Rust, examining the engineering tradeoffs between Zig and Rust in systems programming.

Jul 27, 2026·3 min

Midjourney's Multi-Industry Expansion: The Cross-Domain Logic Behind Its Move from AI Art to Healthcare and Astrology

Midjourney expands from AI image generation into medical scanning, spas, and astrology apps. Behind the seemingly chaotic diversification lies a clear strategic logic of generative AI's horizontal penetration.

Jul 27, 2026·7 min

DIY Companion Robot: Building Your AI Desktop Buddy with Jetson Orin

A maker builds a DIY companion robot with NVIDIA Jetson Orin and 4S LiPo battery. Explore the full development journey from first power-up to AI interaction, including edge computing, power design, and companion robot trends.

Jul 26, 2026·4 min

Gemini API in Practice: Building AI Agents with Files

Google's official hands-on: how to go from idea to production fast with AI Studio and build AI Agents using the now-GA Interactions API. The core idea—Agents are just combinations of files.

Jul 26, 2026·5 min

Gemini API in Practice: Building AI Agents with Files

Official Google hands-on: go from idea to production fast with AI Studio, and build AI Agents with the now-GA Interactions API. The core idea: an Agent is just a composition of files—Markdown plus a few scripts, no complex Python loops needed.

Jul 24, 2026·6 min

The Three-Layer GTM Agent Architecture: Enabling AI to Truly Recognize Buyer Intent and Identity

An in-depth analysis of the three-layer GTM Agent architecture—the Signal, Buyer Intelligence, and Action layers—revealing how context graphs identify anonymous visitors and capture purchase intent.

llmfit: One Command to Check Which Loc…

Jul 22, 2026·2 min

llmfit: One Command to Check Which Local LLMs Your Hardware Can Run

llmfit is an open-source Rust CLI tool that predicts whether your local hardware can run a given LLM — no model download required. Covers hundreds of models and backends like Ollama and llama.cpp.

Jul 22, 2026·3 min

Qwen's Six-Generation Evolution: A Complete Breakdown from Architecture Innovations to the Reasoning Race

From Qwen1 to Qwen3-2507: a complete breakdown of six generations of evolution over two years — GQA, MoE, GRPO, dynamic thinking, and the core shift from architecture to reasoning.

Jul 21, 2026·2 min

WeChat Mini Program Cloud Development in Practice: A Complete Guide for Frontend Developers to Build Full-Stack Apps Solo

Learn how to build full-stack WeChat Mini Programs using only JavaScript. This guide covers cloud databases, cloud functions, and cloud storage with a real-world project.

Jul 21, 2026·3 min

A Former Tencent Engineer's Complete Journey Building a 'Decision Paralysis' Mini Program with AI

A former Tencent engineer used CodeBuddy AI to solo-build a 'Decision Paralysis' mini program — from a phone specs spreadsheet to a fully launched WeChat app.

Brainless: An AI-Native UI Component L…

Jul 18, 2026·2 min

Brainless: An AI-Native UI Component Library Built on Shadcn for Replicating Claude Code's Interface Style

Brainless is an open-source UI component library built on Shadcn/ui, offering Claude Code, OpenAI Codex, and Grok-style components to help developers quickly build AI-native chat and CLI interfaces.

Jul 18, 2026·3 min

Metaview in Practice: Building a Prompt System That Evolves With User Preferences

Metaview engineer Nick Mayhew explains how to build self-evolving prompt systems: Markdown over rules, layered workflows to cut token costs, and agents that learn user preferences for human-centered AI recruiting.