#AI inference optimization
1769 related articles
Tutorials·2 min
ONNX Model Deployment in Practice: A Complete Guide from PyTorch Export to Cross-Framework Inference
Complete guide to ONNX neural network exchange format: PyTorch and TensorFlow model export, ONNX Runtime inference, MNIST classifier deployment, and HuggingFace model downloads with runnable code examples.
Read more →
Tutorials·2 min
Java + AI: A Practical Path for Programmers to Break Through the Age-35 Career Crisis
How Java programmers can break through the age-35 career bottleneck by stacking AI skills. Covers AI learning levels, Java+AI synergy, and actionable transition strategies.
Read more →
Tutorials·2 min
How to Use Gemini 3.5 Flash in China? 6 Methods Tested and Working (2025 Latest)
Gemini 3.5 Flash surpasses 3.1 Pro with 4x speed and half the price. Learn 6 tested methods to access Gemini 3.5 from China, including free AI Studio, no-VPN relay services, and API options.
Read more →
Product Reviews·2 min
Google AntiGravity 2.0 In-Depth Review: Desktop App, Go-Rewritten CLI, and Gemini 3.5 Flash Hands-On
In-depth analysis of Google I/O 2026's AntiGravity 2.0 desktop app, Go-rewritten CLI, and Gemini 3.5 Flash model. Covers multi-agent workflow testing, benchmarks, and competition with Claude Code/Cursor.
Read more →
Tech Frontiers·2 min
Sam Altman and Jony Ive Merge IO into OpenAI: A New Era of AI-Native Hardware
OpenAI CEO Sam Altman and former Apple design chief Jony Ive announce IO's merger with OpenAI to build AI-native hardware. Altman calls it "the coolest tech product ever," aiming to democratize AI.
Read more →
Tutorials·2 min
DeepSeek + Cursor + DevBox: Complete Project Development and Deployment with Zero Coding Experience
Learn how DeepSeek + Cursor + DevBox enables zero-code project development from design to deployment, perfect for beginners and non-programmers.
Read more →
Tutorials·2 min
Python Machine Learning in Practice: A Complete Guide from Algorithm Derivation to Code Implementation
A systematic Python ML course using a 3-stage framework: algorithm derivation, code implementation, and experimental analysis. Covers logistic regression, decision trees, and ensemble learning.
Read more →
Tutorials·2 min
How to Tell If Your GPU Is Out of VRAM When Running Local LLMs: A Complete Guide to VRAM Monitoring
How to tell if your GPU is out of VRAM when running local LLMs. Learn the difference between dedicated and shared GPU memory, monitor VRAM overflow via Task Manager, and use quantization and context length control to avoid OOM.
Read more →
Product Reviews·2 min
Codex vs. Cloud Code: An In-Depth Comparison — How to Choose Your AI Coding Tool in 2025
In-depth comparison of Codex APP, Cloud Code, and Cursor — pricing, stability, and capabilities from frontend UI to backend logic — to help developers choose the right AI coding assistant.
Read more →
Deep Dives·1 min
Gemini 3.5 Flash Deep Dive: Google's AI Agent Execution Engine
Google I/O 2025 unveils Gemini 3.5 Flash—4x faster than frontier models, outperforming its own flagship on coding and Agent benchmarks. Deep dive into its core capabilities and industry impact.
Read more →
Product Reviews·1 min
DeepSeek V4 vs Qwen3.6 Real-World Testing: In-Depth Comparison Across 8 Categories and 150 Scenarios
BenchLocal real-world testing of DeepSeek V4 Pro, V4 Flash vs Qwen3.6 27B across 8 categories and 85 scenarios. V4 Pro leads by 6% but stumbles on math reasoning. Qwen3.6 Q6 rivals V4 Pro in agent tasks.
Read more →
Product Reviews·1 min
Qwen3.6-27B Open-Source Model Review: Flagship-Level Code and Multimodal Capabilities with Just 27B Parameters
Deep dive into Alibaba's Qwen3.6-27B: a 27B dense model delivering flagship-level code generation and multimodal capabilities on a single GPU with INT4 quantization.
Read more →
Tutorials·2 min
Hermes + Qwen3.6 Local Deployment Tutorial: Build Your Private AI Agent at Zero Cost
Step-by-step tutorial to deploy Hermes Agent with Qwen3.6 open-source LLM locally. Covers WSL setup, model download, Telegram bot integration for a zero-cost private AI Agent.
Read more →
Tutorials·2 min
vLLM and SGLang Local Deployment Tutorial: A Practical Guide to 3-8x Performance Gains
Complete guide to deploying vLLM and SGLang locally. Compare performance vs LM Studio, deploy in 3 steps with Docker + AI assistant. Covers SGLang vs vLLM selection, 5090 VRAM optimization, and Cherry Studio integration.
Read more →
Industry Insights·2 min
Enterprise LLM Selection Guide: In-Depth Comparison of Llama 3.1, Qwen 2.5, and DeepSeek
How should enterprises choose open-source LLMs? This guide compares Llama 3.1, Qwen 2.5, DeepSeek, and Mistral across model capabilities, hardware requirements, and business scenarios.
Read more →
Tutorials·2 min
VS Code Claude Code + DeepSeek V4 Pro Configuration Tutorial (5 Steps)
Step-by-step tutorial: Connect VS Code's Claude Code plugin to DeepSeek V4 Pro via CCSwitch, bypassing auth limits and cutting AI coding costs to 25%.
Read more →
Industry Insights·1 min
OpenAI's Five Leading Indicators: Why It Remains the Front-Runner in the AI Race
Deep analysis of OpenAI's five competitive advantages: Codex's explosive growth, full cloud coverage, ChatGPT's consumer dominance, compute strategy, and top research talent.
Read more →
Deep Dives·2 min
How Fast Is 10 Tokens Per Second from an LLM? An Open-Source Tool for Visualizing Token Generation Speed
An open-source tool lets you visualize LLM token generation speeds from 5-800 TPS, helping developers make rational choices about model selection and inference optimization.
Read more →
Tech Frontiers·1 min
Claude 4 Launch: Opus and Sonnet Dual Models Explained, Coding Agent Capabilities Fully Upgraded
Anthropic launches Claude 4 Opus and Claude 4 Sonnet. Claude Code goes GA with IDE integration and SDK. MCP protocol connects directly to API. Full breakdown of coding and agent upgrades.
Read more →
Tutorials·2 min
DeepSeek R1 Usage Guide: Prompt Techniques & Practical Tips (2025)
A detailed guide to DeepSeek R1's reasoning capabilities and prompt techniques, covering reasoning vs. general models, core capabilities, and practical prompt strategies for 2025.
Read more →