#memory optimization
1739 related articles
Deep Dives·4 min
Context Engineering Explained: The AI Paradigm Shift from Prompt to Context Engineering
Deep dive into Context Engineering: its core principles and practices. From Prompt Engineering to context design, orchestration, and optimization—exploring how Karpathy's new AI paradigm reshapes LLM app development and AI Agent construction.
Read more →
Product Reviews·3 min
Cube Studio: A Comprehensive Analysis of Tencent's Open-Source Cloud-Native AI Platform
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning & inference, Pipeline orchestration, and domestic hardware adaptation.
Read more →
Tutorials·3 min
GitHub 8K Stars: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources with 8,200+ Stars, covering multimodal AI, Agents, MCP protocol, model training, inference optimization, and coding assistants.
Read more →
Product Reviews·2 min
Unsloth: 80% VRAM Reduction — The Best Open-Source Tool for Local LLM Fine-Tuning
Unsloth is an open-source LLM training tool with 63K+ GitHub stars, supporting Gemma 4, Qwen 3, DeepSeek. Reduces VRAM by 50–80%, enabling RTX 4090 to fine-tune 7B models with a no-code Web UI.
Read more →
Tech Frontiers·2 min
Kimi K2 Official Verification Tool K2-Vendor-Verifier: One-Click API Vendor Model Accuracy Detection
Moonshot AI open-sources K2-Vendor-Verifier to verify third-party Kimi K2 API vendor inference accuracy. Learn how this tool helps developers detect over-quantization, model substitution, and other API market risks.
Read more →
Expert Opinions·3 min
Why the Zig Project Strictly Bans AI Contributions: Investing in People, Not Code
The Zig programming language enforces the strictest anti-LLM policy in open source, banning AI in PRs and Issues. Its "Contributor Poker" philosophy reveals why: open source value lies in cultivating people, not merging code.
Read more →
Product Reviews·3 min
awesome-LLM-resources: A Deep Dive into GitHub's 8K-Star Comprehensive LLM Learning Resource Repository
Deep dive into awesome-LLM-resources, a GitHub 8K-star project covering multimodal AI, AI Agents, MCP protocol, model training/inference, and AI coding tools — a one-stop LLM learning guide.
Read more →
Research·3 min
SVDQuant: 4-bit Quantization Enables Efficient Diffusion Model Inference on Consumer GPUs
SVDQuant, an ICLR 2025 Spotlight paper, achieves 4-bit diffusion model quantization via low-rank decomposition that absorbs outliers, reducing memory by 75%. Open-source engine Nunchaku (3800+ stars) enables FLUX inference on consumer GPUs like RTX 4060.
Read more →
Tutorials·3 min
Building an AI Digital Human Agent from Scratch: Architecture Design & Full Technical Breakdown
Complete guide to building an AI digital human Agent, covering Agent, RAG, WebRTC, and Docker deployment with architecture design and engineering best practices.
Read more →
Tech Frontiers·2 min
Datasette 1.0a29 Released: Fixing a Gnarly Segfault Race Condition with GPT-5.5
Datasette 1.0a29 preview released, fixing a segfault race condition introduced by test optimization. Developer Simon Willison used GPT-5.5 xhigh to help reproduce the issue, showcasing AI debugging in practice.
Read more →
Tech Frontiers·2 min
OpenAI Symphony: One Codex Agent Per Task — A New Paradigm for Multi-Agent Parallel Programming
Deep dive into OpenAI's Symphony: assigning an independent Codex agent to each task for multi-agent parallel programming. Explore its architecture, developer impact, and industry trends.
Read more →
Deep Dives·3 min
Augment Code Architecture Revealed: Dedicated Subagents Replace KV Cache, Cutting Costs by 90%
Deep dive into how Augment Code uses Mercury 2 dedicated subagents to replace traditional KV cache, achieving 82% faster context compaction, 90% lower summarization costs, and 30% reduced LLM spending.
Read more →
Tech Frontiers·3 min
Google Aluminium OS Leaked: Full Demo of Android Desktop PC System Exposed
Google's new Aluminium OS leaked in a 16-minute video, revealing a full Android-based desktop OS for PC. It could challenge Windows, Chrome OS, and macOS.
Read more →
Product Reviews·2 min
Perfect-Web-Clone: A Deep Dive into the Pixel-Perfect Web Cloning Tool Built on Multi-Agent Architecture
Deep dive into the Perfect-Web-Clone open-source project: how its Claude Agent SDK multi-agent architecture and 40+ specialized tools achieve pixel-perfect web cloning beyond Cursor and single-model tools.
Read more →
Tech Frontiers·2 min
LlamaIndex Integrations Get a Major Overhaul: Key Upgrade Points Every Developer Should Know
LlamaIndex official integrations get a major overhaul covering API optimization, documentation improvements, and unified interfaces. Learn the impact on RAG and LLM app development with migration tips.
Read more →
Tech Frontiers·2 min
DeepSeek V3.2 Released: Proprietary Sparse Attention (DSA) + 50% API Price Cut Explained
DeepSeek releases V3.2-Exp with proprietary DeepSeek Sparse Attention (DSA) for faster long-context training and inference, plus API prices cut over 50%.
Read more →
Tech Frontiers·3 min
Simulation Reshaping AI Testing: A New Paradigm for Systematically Validating AI Application Reliability
Explore how simulation solves AI testing challenges, covering scenario simulation, large-scale regression testing, and multi-agent verification to build reliable AI systems.
Read more →
Tech Frontiers·3 min
Karpathy Open-Sources autoresearch: A Deep Dive into the AI-Powered Automated Research Tool with 80K Stars
Andrej Karpathy open-sources autoresearch, an AI Agent tool that automates nanochat training experiments on a single GPU. With 80K+ GitHub Stars, we break down its architecture and impact.
Read more →
Tutorials·3 min
The Complete Guide to MLflow: An Open-Source AI Engineering Platform from Experiment Tracking to LLM Deployment
A deep dive into the MLflow open-source AI engineering platform, covering experiment tracking, LLM evaluation, model deployment, and monitoring to help teams efficiently manage the ML lifecycle.
Read more →
Product Reviews·3 min
MaxKB Open-Source Agent Platform: A Deep Dive into the 20K-Star Enterprise Knowledge Base RAG Solution
Deep dive into MaxKB, an open-source enterprise agent platform with 20K+ GitHub Stars. Explore its RAG capabilities, multi-model integration, visual orchestration, and comparison with Dify and FastGPT.
Read more →