#CUDA inference setup
88 related articles
Product Reviews·3 min
Google Gemma 4 Hands-On Review: Offline on Smartphones + Ollama Deployment Tutorial
Hands-on testing of Google Gemma 4 open-source models running offline on three phones, with Dense vs MOE architecture explained and a complete Ollama + Claude Code deployment tutorial.
Read more →
Tutorials·3 min
Why Learning AI from Scratch Leaves You More Confused — A Clear, Systematic Roadmap for Beginners
Confused learning AI from scratch? This guide breaks down why fragmented learning fails and provides a complete path from Python to deep learning with practical tips.
Read more →
Tutorials·4 min
Practical Guide to Building a Local AI Knowledge Base with Qwen3.5 + RAGFlow + Ollama
Step-by-step guide to building a local RAG knowledge base using RAGFlow, Ollama, and LM Studio with Docker, covering Embedding model deployment and network troubleshooting for private AI Q&A.
Read more →
Tutorials·1 min
AI Agent Learning Roadmap: A Complete Guide from LLM Fundamentals to Enterprise-Level Project Implementation
A systematic AI Agent learning roadmap covering Python setup, Prompt Engineering, RAG, LangChain, multi-Agent collaboration, with enterprise medical consultation system case study and phased learning plan.
Read more →
Product Reviews·3 min
Deep Dive into Tencent Marvis: How a System-Level AI Assistant Redefines Human-Computer Interaction
Deep dive into Tencent Marvis system-level AI assistant, analyzing its local knowledge base, semantic search, privacy mode, and how Agents evolve from tools to OS integration.
Read more →
Tutorials·3 min
Running AI Models on a P106 Mining GPU: Build a Local AI Workstation for Under $10
Build a local AI workstation with a P106 mining GPU for under $10. Run Live Portrait and other AI models locally with full privacy, zero marginal cost, and incredible value.
Read more →
Tutorials·3 min
LLM Learning Roadmap: A Complete Guide from Beginner to Project Implementation Across Seven Core Modules
A systematic breakdown of seven core LLM learning modules covering environment setup, Prompt Engineering, RAG, Agents, dev frameworks, fine-tuning, and hands-on projects for developers.
Read more →
Tutorials·2 min
Hermes + Qwen3.6 Local Deployment Tutorial: Build Your Private AI Agent at Zero Cost
Step-by-step tutorial to deploy Hermes Agent with Qwen3.6 open-source LLM locally. Covers WSL setup, model download, Telegram bot integration for a zero-cost private AI Agent.
Read more →
Tutorials·2 min
MoS-TTS-Nano Deployment Guide: Ultra-Lightweight 0.1B TTS Model That Runs on CPU
Battle-tested MoS-TTS-Nano local deployment guide. 0.1B ultra-lightweight TTS model runs on quad-core CPU without GPU. Covers Conda setup, pynini installation fixes, model download, and Gradio WebUI.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →
Tutorials·4 min
Codex + Ollama Local Deployment Guide: Build a Free AI Coding Assistant at Zero Cost
Step-by-step guide to deploying Codex with Ollama locally for a free AI coding assistant, covering hardware checks, Ollama setup, model downloads, and full integration configuration.
Read more →
Tutorials·3 min
Ollama + OpenCode Local AI Coding: A Complete Zero-Cost Alternative to Cursor
Tutorial: Deploy Qwen3 Coder locally via Ollama with OpenCode for zero-cost AI coding. Covers setup, code generation, auto-debugging, and hardware recommendations.
Read more →
Tutorials·4 min
Whisper Local Deployment Guide: Step-by-Step Setup for a Free Speech-to-Text Tool
Step-by-step tutorial for locally deploying OpenAI Whisper speech recognition, covering Conda setup, PyTorch installation, model selection, and transcription operations with free SRT subtitle generation.
Read more →
Tutorials·3 min
LocalAI Tutorial: Deploy LLMs Locally Without a GPU Using Docker
Complete LocalAI deployment tutorial: run nearly 1,000 open-source LLMs locally without a GPU. One-click Docker setup, OpenAI API compatible, supports chat, image generation, and voice — fully private.
Read more →
Tutorials·3 min
WSL2 Installation Guide: Complete Tutorial from Setup to Non-System Drive Migration
Complete WSL2 installation tutorial covering enabling Windows features, installing Ubuntu 22.04, and migrating to a non-system drive. Includes PowerShell commands and user configuration for AI developers.
Read more →
Tutorials·3 min
4-bit QLoRA Fine-tuning LLaMA 3 in Practice: A Guide to Training 8 Billion Parameter LLMs on Consumer GPUs
Learn how to fine-tune LLaMA 3 8B on consumer GPUs using QLoRA and Unsloth. Covers 4-bit quantization, LoRA adaptation, Alpaca data format, training pipeline setup, and model deployment—runs on RTX 3090.
Read more →
Product Reviews·4 min
ComfyUI-Copilot: An AI Assistant for Building Stable Diffusion Workflows with Natural Language
ComfyUI-Copilot is an open-source AI assistant plugin supporting natural language workflow building, smart node recommendations, and parameter optimization. With 5,100+ GitHub stars, it dramatically lowers the barrier to Stable Diffusion workflow creation.
Read more →
Product Reviews·3 min
The Complete Guide to AnythingLLM: A Privacy-First AI Assistant for Local Deployment
Deep dive into AnythingLLM: a privacy-first, zero-config open-source local AI tool. Supports RAG, multi-model switching, and document chat. Nearly 60K GitHub Stars, ideal for enterprise and personal local deployment.
Read more →
Tutorials·2 min
Ollama Tutorial: One-Click Local Deployment of DeepSeek, Qwen, and Other LLMs
Complete guide to running LLMs locally with Ollama. Supports DeepSeek, Qwen, Kimi-K2.5 & more. Covers installation, model ecosystem, privacy benefits & enterprise deployment. 170K+ GitHub Stars.
Read more →
Tutorials·2 min
Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training
Learn how Unsloth enables efficient local LLM fine-tuning with LoRA optimization, supporting Gemma 4, Qwen3, and DeepSeek while reducing VRAM usage by 50% and boosting training speed 2-5x.
Read more →