#LLM inference efficiency
1160 related articles
Deep Dives·1 min
Beginner's Guide to AI Agents: Core Principles, Technical Architecture, and Application Scenarios Explained
A systematic guide to AI Agents covering core principles of perception, decision-making, and action, plus the technical stack of LLMs, tool calling, memory systems, and RAG, with real-world use cases.
Read more →
Tutorials·1 min
DeepSeek + RAGFlow Local Deployment AI Knowledge Base Tutorial (2025 Latest)
Step-by-step guide to locally deploy a personal AI knowledge base with DeepSeek + RAGFlow + Ollama. Covers RAG principles, Ollama setup, Docker deployment, and knowledge base optimization.
Read more →
Deep Dives·2 min
LangChain Core Architecture Explained: A Practical Guide to Its Five Key Modules
Deep dive into LangChain's five core modules: Model I/O, Data Connection & Retrieval, Chains, Agents, and Memory. Learn RAG workflows, Agent decision-making, and practical AI app development.
Read more →
Tech Frontiers·3 min
Google Jules 1.5 Upgrade: Free Task Quota Increased 12x, Development Experience Completely Revamped
Google Jules 1.5 gets a major upgrade with daily free tasks jumping from 5 to 60, plus new copy/download buttons, context preservation, and significant performance improvements.
Read more →
Expert Opinions·3 min
AI Output Quality Correlates 0.92 with Prompting Skill: Judgment Is the Real Moat
Anthropic's 1M conversation study shows 0.92 correlation between prompting skill and AI output quality. Knowledge equality is an illusion—judgment is the real moat in the AI era.
Read more →
Tech Frontiers·4 min
Step 3.5 Flash Deep Dive: How a 196B Parameter Open-Source Model Beat Gemini
Deep dive into StepFun's Step 3.5 Flash: 196B parameter MoE model activating only 11B, 350 tokens/sec coding speed, 256K context window, local deployment ready. How it beats Gemini 3 Flash.
Read more →
Product Reviews·4 min
Manus Hands-On Review: Testing a General-Purpose AI Agent Across Three Real-World Scenarios
Hands-on testing of Manus general AI Agent across history report generation, Tesla stock analysis, and GAIA benchmarks. Compares vertical vs general agents with scoring data and limitation analysis.
Read more →
Product Reviews·4 min
Manus Hands-On Review: One Prompt to Build a Snake Game — What AI Agents Can Really Do
Hands-on Manus AI Agent review: generate a playable Snake game and physics animation site with one prompt. Covers registration, how it differs from ChatGPT, cloud execution, and current limitations.
Read more →
Product Reviews·4 min
Manus Full Public Launch Review: Can an AI Agent Really Help Beginners Build a Social Media Business?
Manus AI Agent is now fully open. This hands-on review tests it through a complete social media startup scenario—from research to content production—revealing its real capabilities and limitations.
Read more →
Tutorials·5 min
Trae MCP Plugin for FoxTable in Action: AI Builds a Complete Business System in 4 Minutes
Learn how a custom MCP plugin connects Trae AI IDE with FoxTable, using knowledge bases and prompt engineering to build a complete business system in 4 minutes.
Read more →
Product Reviews·3 min
Manus vs Tiangong vs Liaobots: AI Subtitle Translation Real-World Scoring Comparison
Real-world comparison of Manus, Tiangong, and Liaobots translating English tech presentation subtitles, scored across colloquial handling, terminology accuracy, and ASR error correction.
Read more →
Deep Dives·3 min
How NVIDIA AI Agents Turn Massive Video Feeds into Searchable, Real-Time Intelligence
Deep analysis of NVIDIA's latest video AI Agent solution, using multimodal LLMs and modular Skills architecture to transform massive surveillance video into searchable real-time intelligence.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →
Tutorials·2 min
Beginner's Guide to AI Large Language Models: GPU Requirements & Core Tech Stack Explained
2025 complete guide to AI LLMs: local deployment GPU/VRAM requirements (RTX 4090/24GB) and core tech stack including Prompt Engineering, Agents, MCP, LangGraph, and WorkFlow orchestration.
Read more →
Product Reviews·3 min
GitHub 8K Stars: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources covering multimodal generation, AI Agents, MCP protocol, model training/inference, o1 models, and SLMs—a community-verified 8200+ Star LLM learning resource hub.
Read more →
Product Reviews·3 min
8K Stars on GitHub: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the awesome-LLM-resources project (8200+ GitHub Stars), covering multimodal AI, Agents, MCP protocol, model training, o1 reasoning, SLMs, and more for LLM practitioners.
Read more →
Product Reviews·3 min
AnythingLLM: A Deep Dive into the All-in-One Local AI Knowledge Base Tool
Deep dive into AnythingLLM, a privacy-first, zero-config local AI productivity platform. Supports RAG document chat, multi-model integration, knowledge bases, and AI Agents with nearly 60K GitHub stars.
Read more →
Product Reviews·4 min
Chatbox Open-Source AI Client: Nearly 40K Stars, All-in-One Multi-Model Chat Management
Deep dive into Chatbox, an open-source AI client with nearly 40K GitHub Stars. Supports GPT-4, Claude, Gemini multi-model switching, local data storage for privacy, and cross-platform desktop use.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.
Read more →
Deep Dives·5 min
Hugging Face Transformers: A Comprehensive Guide to the 160K-Star Open-Source AI Framework
Comprehensive guide to Hugging Face Transformers, the 160K-star GitHub framework—covering architecture, multimodal support, quantization, and inference optimization for loading, fine-tuning, and deploying pre-trained models.
Read more →