#ONNX
61 related articles
·4 min
Ternlight: A 7MB Browser-Side Embedding Model for Server-Free Semantic Search
Ternlight is a 7MB WebAssembly-based browser-side text embedding model requiring no server or GPU. Explore its tech, use cases, and tradeoffs for private, offline semantic search.
Read more →
·5 min
Defending the Right to Run Local AI: A Battle for Privacy, Freedom, and Digital Sovereignty
Local AI faces a triple threat from tightening regulation, hardware lock-downs, and commercial pressure. A deep analysis of why running open-source LLMs on your own device is a digital right worth defending.
Read more →
·3 min
Programmers Pivoting to AI: Opportunities in Application Development and Pitfalls to Avoid
How can ordinary programmers break into AI? This guide breaks down the gap between algorithm engineers and AI app developers, covering Agent development, model fine-tuning, salary trends, and the three hidden risks behind the current opportunity window.
Read more →
·4 min
Tencent Marvis Hands-On: How Multi-Agent AI Takes Over Your Computer
Deep dive into Tencent's Marvis AI agent: multi-agent architecture, intelligent file organization, document analysis, cross-device sync, and local privacy mode explained.
Read more →
·3 min
Java AI Framework Comparison: A Selection Guide for Spring AI, LangChain4J, and More
In-depth comparison of four Java AI frameworks — Spring AI, LangChain4J, DJL, and JBot AI — covering features, use cases, and ecosystem compatibility to guide your selection.
Read more →
·4 min
Deep Learning Lane Detection: From Segmentation to Classification for 300+ FPS Real-Time Inference
Deep learning lane detection algorithm that simplifies dense segmentation into efficient grid classification, achieving 300+ FPS real-time inference with row selection, Focal Loss, and expectation-based localization.
Read more →
·3 min
The Complete Skill Map for AI Application Engineers: A Progressive Roadmap from Fundamentals to Production
A systematic breakdown of the complete skill structure for AI application engineers, covering Python & deep learning fundamentals, small model engineering, LLM fine-tuning, Agent development, and enterprise projects.
Read more →
Deep Dives·3 min
Why Is Python the Top Choice for AI Development? Three Core Reasons Explained in Depth
In-depth analysis of three core reasons Python dominates AI development: simple syntax for quick onboarding, powerful ecosystem, and industry-wide network effects.
Read more →
Tutorials·2 min
pnpm Monorepo Full-Stack AI Engineering in Practice: Building a Multimodal Conversation System
Learn how to build a full-stack multimodal AI conversation system using pnpm Monorepo architecture, covering local model integration, image understanding, and streaming chat.
Read more →
Tutorials·2 min
FastEmbed Tutorial: Installation and Practical Guide for a Lightweight Local Vector Embedding Library
A detailed guide to FastEmbed, a lightweight Python embedding library covering installation, text and image embedding usage, and seamless Qdrant vector database integration for building local AI apps without GPU.
Read more →
Tutorials·2 min
MoS-TTS-Nano Deployment Guide: Ultra-Lightweight 0.1B TTS Model That Runs on CPU
Battle-tested MoS-TTS-Nano local deployment guide. 0.1B ultra-lightweight TTS model runs on quad-core CPU without GPU. Covers Conda setup, pynini installation fixes, model download, and Gradio WebUI.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →
Deep Dives·3 min
AI Model Deployment Pipeline Friction: How TensorRT Systematically Eliminates Inference Optimization Bottlenecks
Deep dive into pipeline friction in AI model deployment from training to production, covering TensorRT automated optimization, ONNX export, and Triton Inference Server best practices.
Read more →
Tech Frontiers·2 min
NVIDIA Developer Account Migration to @NVIDIAAI: A Complete Guide to Brand Consolidation and Developer Impact
NVIDIA's developer team social media has migrated to @NVIDIAAI. Learn about the AI strategy behind this brand consolidation, its impact on the developer community, and recommended actions.
Read more →
Tutorials·3 min
Complete Guide to ComfyUI-Impact-Pack: Essential Plugin for Face Restoration & Image Enhancement
Complete guide to ComfyUI-Impact-Pack's core features: FaceDetailer for face restoration, Detectors, Upscalers, and Pipe systems to fix facial distortion and blurry details in AI-generated images.
Read more →
Product Reviews·2 min
Fast Image Skills: A Detailed Guide to the Ready-to-Use Image Processing Skill Library for AI Agents
Fast Image Skills is an open-source Python project providing ready-to-use image processing skills for AI agents like Claude Code and Cursor, featuring background removal and auto-crop capabilities.
Read more →
Tutorials·3 min
Unsloth Tutorial: Fine-Tune LLMs Locally with Multi-fold Speed Boost and 60% VRAM Savings
Unsloth is an open-source LLM fine-tuning tool with 63K GitHub stars, supporting Gemma 4, Qwen3, and DeepSeek. It achieves multi-fold training speedup and 60% VRAM reduction through kernel optimization, enabling fine-tuning on consumer GPUs.
Read more →
Product Reviews·1 min
Hugging Face Transformers: A Complete Guide to the AI Model Framework with 160K Stars
Explore Hugging Face Transformers, the 160K-star open-source framework for AI models covering text, vision, audio, and multimodal with unified APIs.
Read more →
Deep Dives·4 min
Hugging Face Transformers Deep Dive: Why This 160K-Star AI Open-Source Framework Has Become the Industry Standard
Deep dive into Hugging Face Transformers: core architecture, full-modality support, inference/training capabilities, and community ecosystem. Learn how this 160K-star project became the industry's AI infrastructure.
Read more →
Product Reviews·5 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source Framework
Deep dive into Hugging Face Transformers, covering core features, API design, model ecosystem, and practical code examples. Learn how this 160K-Star project lowers AI barriers and drives democratization across LLMs, computer vision, and multimodal AI.
Read more →