#inference optimization
1833 related articles
Tutorials·3 min
Dify Agent Building Tutorial: Tool Calling & ESA Search Practical Guide
Complete guide to building Dify Agents: Function Call tool calling, ESA search configuration, time awareness solutions, and 161 plugin tools for no-code AI agent development.
Read more →
Tutorials·4 min
Dify AI Agent Tutorial: Tool Integration & ESA Search Configuration in Practice
Complete guide to building AI Agents on Dify with zero code, covering tool integration, ESA search configuration, time awareness solutions, and Agent design best practices.
Read more →
Tutorials·3 min
4-bit QLoRA Fine-tuning LLaMA 3 in Practice: A Guide to Training 8 Billion Parameter LLMs on Consumer GPUs
Learn how to fine-tune LLaMA 3 8B on consumer GPUs using QLoRA and Unsloth. Covers 4-bit quantization, LoRA adaptation, Alpaca data format, training pipeline setup, and model deployment—runs on RTX 3090.
Read more →
Product Reviews·3 min
awesome-LLM-resources: A Comprehensive Analysis of the 8,200-Star LLM Learning Resource Repository on GitHub
In-depth analysis of the 8,200-star GitHub project awesome-LLM-resources, covering multimodal generation, Agents, model training, MCP protocol, and more — a one-stop LLM learning guide.
Read more →
Tutorials·2 min
Cursor 3.3 Context Usage Analysis: A Complete Guide to Understanding and Optimization
Cursor 3.3 adds Agent context usage analysis, helping developers visualize Rules, MCP, Skills context consumption. Learn how to optimize AI programming efficiency.
Read more →
Tech Frontiers·2 min
Stability AI Composer 2 SDK at Half Price for Limited Time: How Developers Can Seize This Deal
Stability AI announces a limited-time 50% discount on Composer 2 SDK. This article breaks down the deal, Composer 2's core capabilities, and AI market pricing trends to help developers decide.
Read more →
Tech Frontiers·2 min
SWE-bench Opens Evaluation Environments and Training Recipes: Dramatically Lowering the Barrier to AI Coding Agent Development
SWE-bench opens evaluation environments, task sets, trajectories, and training recipes, dramatically lowering the barrier to AI coding agent development.
Read more →
Tech Frontiers·2 min
Cursor Launches Claude Opus 4 Fast Mode: 2.5x Faster, 6x More Expensive — Is It Worth It?
Cursor launches Claude Opus 4 Fast Mode with 2.5x speed but 6x cost. We analyze use cases, cost tradeoffs, and practical tips to help you decide if it's worth it.
Read more →
Product Reviews·3 min
ChuanhuChatGPT: A Comprehensive Analysis of the 15K-Star Open-Source Multi-Model Chat Interface
Deep dive into ChuanhuChatGPT, a 15K-star open-source project with multi-model access, Agent support, RAG file Q&A, GPT fine-tuning, and web search.
Read more →
Tech Frontiers·2 min
Qwen Continues to Lead on SWE-bench: The Rise of Open-Source AI Coding Models
Qwen team leads open-source models on SWE-bench, demonstrating strong software engineering capabilities. This article analyzes SWE-bench standards, Qwen's progress, and the value of open-source AI coding tools.
Read more →
Deep Dives·3 min
AgentPay: A Deep Dive into the Decentralized Payment Marketplace for Autonomous AI Agent Transactions
Deep dive into AgentPay, an open-source project enabling AI agents to autonomously provide DeFi optimization, smart contract auditing services and settle payments via stablecoins in a decentralized marketplace.
Read more →
Product Reviews·3 min
AutoGPT: A Deep Dive into the Open-Source AI Agent Platform with 180K Stars
Deep dive into the AutoGPT open-source project, covering its autonomous AI agent architecture, core features, use cases, and future development. Learn how this 184K-Star GitHub project makes autonomous AI accessible to everyone.
Read more →
Deep Dives·4 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source AI Framework
Deep dive into Hugging Face Transformers: the 160K-Star open-source framework covering Pipeline API, Auto Classes, multi-modal models, and the full HF ecosystem for AI inference and training.
Read more →
Deep Dives·4 min
Context Engineering Explained: The AI Paradigm Shift from Prompt to Context Engineering
Deep dive into Context Engineering: its core principles and practices. From Prompt Engineering to context design, orchestration, and optimization—exploring how Karpathy's new AI paradigm reshapes LLM app development and AI Agent construction.
Read more →
Product Reviews·3 min
Cube Studio: A Comprehensive Analysis of Tencent's Open-Source Cloud-Native AI Platform
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning & inference, Pipeline orchestration, and domestic hardware adaptation.
Read more →
Product Reviews·2 min
IBM Granite 4.1 Open-Source Models: Real-World SVG Generation Comparison Across 21 GGUF Quantization Variants
IBM releases Granite 4.1 Apache 2.0 open-source LLMs. Simon Willison tests all 21 GGUF quantization variants from Unsloth, revealing that 3B model limitations overshadow precision differences.
Read more →
Tutorials·3 min
GitHub 8K Stars: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources with 8,200+ Stars, covering multimodal AI, Agents, MCP protocol, model training, inference optimization, and coding assistants.
Read more →
Product Reviews·2 min
Unsloth: 80% VRAM Reduction — The Best Open-Source Tool for Local LLM Fine-Tuning
Unsloth is an open-source LLM training tool with 63K+ GitHub stars, supporting Gemma 4, Qwen 3, DeepSeek. Reduces VRAM by 50–80%, enabling RTX 4090 to fine-tune 7B models with a no-code Web UI.
Read more →
Tech Frontiers·2 min
Kimi K2 Official Verification Tool K2-Vendor-Verifier: One-Click API Vendor Model Accuracy Detection
Moonshot AI open-sources K2-Vendor-Verifier to verify third-party Kimi K2 API vendor inference accuracy. Learn how this tool helps developers detect over-quantization, model substitution, and other API market risks.
Read more →
Tech Frontiers·3 min
CL4R1T4S Project: Massive Leak of Major AI System Prompts Sparks Transparency Debate with 25,000+ Stars
GitHub project CL4R1T4S leaked system prompts from ChatGPT, Claude, Gemini and other major AI products, earning 25,000+ Stars and igniting debate over AI transparency vs. security.
Read more →