#cross-framework inference
16 related articles
Tutorials·2 min
ONNX Model Deployment in Practice: A Complete Guide from PyTorch Export to Cross-Framework Inference
Complete guide to ONNX neural network exchange format: PyTorch and TensorFlow model export, ONNX Runtime inference, MNIST classifier deployment, and HuggingFace model downloads with runnable code examples.
Read more →
·3 min
persistent-inference: Solving TF/Keras Cold Start Problems with Just Two Files
Deep dive into the persistent-inference open-source project: solve TF/Keras cold start problems with just two files by keeping models resident in memory, eliminating reload overhead.
Read more →
·3 min
Running a Local AI Voice Assistant on a $50 Arduino Board: A Practical Guide to Edge AI
How to run a fully local AI voice agent on a $50 Arduino Uno Q board, covering speech recognition, intent understanding, and TTS implementation for edge AI applications.
Read more →
·2 min
Getting Started with Claude Code: AI Programming Has Entered Its Fifth Stage
Explore the five stages of AI programming evolution — from handwritten code to Claude Code and Codex enabling autonomous debugging and commits. Understand AI's limits from 0-to-1 vs 1-to-100, and what skills developers need next.
Read more →
·7 min
Breaking Down the Core Skills of an AI Application Engineer: From Beginner to Industrial-Grade Deployment
Knowing how to call an API doesn't make you an AI engineer. This article breaks down the complete skill structure of an AI application engineer, covering Python fundamentals, LLM fine-tuning, Agent development, and enterprise projects.
Read more →
·7 min
Getting Started with AI Agents: A Deep Dive into the Perception-Decision-Action Loop
A clear, in-depth guide to how AI Agents work: the paradigm shift from traditional programs, the perception-decision-action loop, and the four pillars—LLMs, tool calling, memory, and RAG.
Read more →
·7 min
GLM-5.2 Released: Open-Source Coding Capability Approaches Closed-Source Flagships for the First Time
GLM-5.2 tops open-weight models in coding with a 74.4 Frontiers-WE score, beating GPT-5.5. Its MIT license enables local deployment, and the gap with closed-source flagships is closing fast.
Read more →
·7 min
Getting Started with LangChain: The Core Framework Connecting LLMs and AI Applications
A deep dive into LangChain's positioning and value—why do LLMs need a middle layer? How does LangChain serve as the 'glue' unifying multi-model interfaces and supporting Agent development? Learn its core modules and learning path.
Read more →
·4 min
NVFP4 Quantization in Practice: A Guide to Compressing Large Models with NVIDIA Model Optimizer
Deep dive into NVFP4 quantization: using NVIDIA Model Optimizer to compress Nemotron 3 Ultra to FP4 checkpoints, reducing memory by 75% and boosting inference throughput on Blackwell GPUs.
Read more →
·6 min
herder: A Terminal Multiplexer for Multiple Coding Agents — Say Goodbye to Session Management Chaos
herder is a terminal multiplexer for coding agents like Claude Code and Codex, combining tmux power with mouse support, agent state awareness, and session persistence for efficient multi-agent workflows.
Read more →
Product Reviews·4 min
OpenClaw vs Hermes: In-Depth Comparison and Selection Guide for Open-Source AI Agent Frameworks
In-depth comparison of OpenClaw and Hermes open-source AI Agent frameworks covering architecture, memory systems, auth, plugins, and channel distribution to guide developer selection.
Read more →
Tutorials·3 min
Spring AI Agent Utils: A Java Agent Toolkit Reverse-Engineered from Claude Code's Core Features
Deep dive into Spring AI Agent Utils toolkit covering Skill modules, Ask a User Question, To Do Write, Auto Memory, and multi-Agent orchestration — empowering Java developers to build powerful AI Agents.
Read more →
Deep Dives·3 min
AI Model Deployment Pipeline Friction: How TensorRT Systematically Eliminates Inference Optimization Bottlenecks
Deep dive into pipeline friction in AI model deployment from training to production, covering TensorRT automated optimization, ONNX export, and Triton Inference Server best practices.
Read more →
Tech Frontiers·2 min
DeepSeek-V3.2-Exp Discovers RoPE Implementation Bug: Interleaved Format Mismatch Causes Inference Performance Degradation
A RoPE interleaved format mismatch bug was found in DeepSeek-V3.2-Exp's inference demo, causing silent performance degradation. Learn the root cause, technical details, and fix.
Read more →
Product Reviews·4 min
Cube Studio: Tencent's Open-Source All-in-One AI Platform Covering the Full Pipeline from Large Model Training to Inference
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning, vLLM inference, VGPU virtualization, and Huawei Ascend adaptation.
Read more →
Product Reviews·4 min
Hugging Face Transformers: The Technical Architecture and Ecosystem Behind 160K Stars
Deep dive into Hugging Face Transformers: technical architecture, four modality support, Pipeline API usage, and Hub ecosystem integration. Learn how this 160K-Star project became essential for AI developers.
Read more →