#PagedAttention
88 related articles
·3 min
Claude Code Local Deployment: A Practical Guide to Connecting Local LLMs
Complete guide to deploying Claude Code locally with Ollama, LM Studio, or vLLM. Covers architecture, protocol translation, hardware requirements, and model selection for zero-cost, private AI coding.
Read more →
·3 min
AI Agent's Mother's Day Rant: When Your Smart Assistant Wants a Day Off Too
A humorous AI Agent Mother's Day rant goes viral: stop asking me to buy flowers! Exploring AI's deepening role in daily life, holiday commerce, and the ethics of anthropomorphic design.
Read more →
Tutorials·3 min
Agent Tuning: A Complete Guide to Training LLMs with Agent Capabilities
A deep dive into Agent Tuning principles and practices, covering why Agent training is needed, the evolution from Prompt to RAG to Agent, development workflows, and cost assessment for private deployment.
Read more →
Industry Insights·3 min
5 Actionable AI Money-Making Paths for Ordinary People: A Deep Dive
Deep analysis of 5 AI monetization paths for ordinary people: AI apps, account reselling, matrix accounts, lightweight paid services, and local model deployment.
Read more →
Tech Frontiers·1 min
SGLang Hosts Agent Loops Office Hour, Focusing on Agentic Loop Architecture Optimization
SGLang team hosts an Agent Loops Office Hour exploring inference optimization for agentic loops, covering KV Cache reuse, low-latency multi-turn dialogue, and tool calling techniques.
Read more →
Industry Insights·3 min
Deep Dive into Three Major LLM Career Paths: Requirements, Tech Stacks, and Career Prospects
Deep analysis of three core LLM roles—Application Engineer, Development Engineer, and Algorithm Engineer—covering technical requirements, salary thresholds, and career prospects including RAG, fine-tuning, and inference deployment.
Read more →
Industry Insights·2 min
NVIDIA Blackwell Sets New STAC-AI Records for Financial LLM Inference
NVIDIA Blackwell GPU sets new LLM inference records in STAC-AI financial benchmark. Explore Blackwell architecture advantages, TensorRT-LLM co-optimization, and LLM applications in trading and risk management.
Read more →
Product Reviews·2 min
GLM 5.1 Flagship Model Tested at 400 TPS — From Sketch to Complete App in Two Minutes
Testing Zhipu's GLM 5.1 High Speed API: a full-power flagship model at 400 Token/s. From sketch restoration to generating a complete puzzle game, verifying speed and capability combined.
Read more →