#CUDA AI inference
326 related articles
Tutorials·3 min
Unsloth Tutorial: Fine-Tune LLMs Locally with Multi-fold Speed Boost and 60% VRAM Savings
Unsloth is an open-source LLM fine-tuning tool with 63K GitHub stars, supporting Gemma 4, Qwen3, and DeepSeek. It achieves multi-fold training speedup and 60% VRAM reduction through kernel optimization, enabling fine-tuning on consumer GPUs.
Read more →
Tutorials·2 min
Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training
Learn how Unsloth enables efficient local LLM fine-tuning with LoRA optimization, supporting Gemma 4, Qwen3, and DeepSeek while reducing VRAM usage by 50% and boosting training speed 2-5x.
Read more →
Product Reviews·1 min
Unsloth: An Efficient Open-Source Tool for Local LLM Fine-Tuning
Unsloth is a 63,000+ star open-source project on GitHub with a Web UI for locally training and fine-tuning LLMs like Gemma 4, Qwen3, and DeepSeek on consumer GPUs.
Read more →
Tutorials·2 min
Ollama Tutorial: Complete Guide to Running DeepSeek, Qwen, and Other LLMs Locally with One Click
Complete guide to Ollama: install and run DeepSeek, Qwen, Kimi-K2.5, GLM-5 and more LLMs locally. 170K+ GitHub Stars, the most popular local LLM framework for offline AI inference and privacy.
Read more →
Deep Dives·1 min
AI Fundamentals Open-Source Treasure Trove: Comprehensive Coverage from GPU Architecture to AI Agents
Discover AI-fundermentals, an open-source project covering GPU architecture, CUDA programming, LLM fundamentals, and AI Agents in one systematic knowledge base.
Read more →
Tutorials·3 min
Ollama Tutorial: The Simplest Way to Run DeepSeek and Other LLMs Locally
Complete guide to deploying LLMs locally with Ollama. Supports DeepSeek, Qwen, Kimi-K2.5 and more. Learn how this 170K-Star open-source tool enables one-click setup, offline inference, and ecosystem integration.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop Cloud-Native AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, LLM fine-tuning, inference deployment, VGPU virtualization, and domestic hardware support for enterprise MLOps.
Read more →
Tutorials·3 min
The Complete Guide to AnythingLLM: A Privacy-First AI Productivity Platform with Local Deployment
In-depth guide to AnythingLLM open-source AI platform covering local deployment, RAG document chat, and knowledge base management. Supports Ollama and multiple model backends with zero-config setup. A privacy-first AI productivity tool validated by 60K GitHub Stars.
Read more →
Product Reviews·4 min
AnythingLLM: A Privacy-First RAG Platform with 60K Stars for Local AI Knowledge Bases
Deep analysis of AnythingLLM: a 60K-Star open-source AI platform supporting local deployment, zero-config setup, built-in RAG document Q&A, and vector database for privacy-first AI productivity.
Read more →
Product Reviews·5 min
LobeHub Open Source Platform Analysis: How 76K Stars Multi-Agent Collaboration Is Reshaping Work
Deep analysis of LobeHub's open-source multi-agent collaboration platform with 76K+ GitHub Stars. Explore its core features, technical architecture, community ecosystem, and how multi-Agent collaboration is reshaping the future of work.
Read more →
Product Reviews·4 min
Unsloth: The Open-Source Tool That Makes Local LLM Fine-Tuning 5x Faster
Unsloth is an open-source LLM fine-tuning tool with 63K+ GitHub stars. Supporting Gemma 4, Qwen 3, and DeepSeek, it boosts training speed 2-5x and cuts VRAM by 80% via LoRA/QLoRA, with a Web UI for easy local fine-tuning.
Read more →
Tutorials·5 min
The Complete Guide to Ollama: Run DeepSeek and Other LLMs Locally with a Single Command
Ollama is an open-source tool with 170K GitHub Stars that lets you run DeepSeek, Qwen, Kimi-K2.5 and other LLMs locally with one command. Learn about its model ecosystem, advantages, and use cases.
Read more →
Product Reviews·5 min
Unsloth: The Open-Source Tool That Speeds Up Local LLM Fine-Tuning by 5x
Unsloth is an open-source LLM training tool with 63,000+ GitHub Stars. It supports local fine-tuning of Gemma 4, Qwen3, DeepSeek and more, with Web UI, VRAM optimization, and 2-5x training speedup on consumer GPUs.
Read more →
Tutorials·4 min
Ollama Tutorial: Run DeepSeek and Other LLMs Locally with a Single Command
Complete guide to running LLMs locally with Ollama. Supports DeepSeek, Qwen, Gemma and more. Learn installation, architecture, and use cases—zero API costs with full data privacy.
Read more →
Product Reviews·2 min
Unsloth: The Free Local LLM Training Tool with 60K+ Stars on GitHub — A Complete Guide
Unsloth is a 63K-star open-source tool for local LLM training with Web UI. Supports Gemma 4, Qwen 3, DeepSeek fine-tuning with 2-5x speed boost on consumer GPUs.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: A Practical Guide to Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Tencent's open-source Cube Studio: architecture, large model training/fine-tuning, vLLM inference, distributed training ecosystem, Ascend adaptation, and VGPU compute management for enterprise MLOps.
Read more →
Product Reviews·4 min
Unsloth: The Efficient Tool for Local Open-Source LLM Training — The Secret Behind 60K+ GitHub Stars
In-depth analysis of Unsloth, a 60K+ star open-source LLM training tool supporting Gemma 4, Qwen3, DeepSeek local fine-tuning with LoRA/QLoRA to dramatically reduce VRAM requirements.
Read more →
Tutorials·5 min
Ollama Tutorial: One-Click Local Deployment of DeepSeek and Other LLMs
Ollama is an open-source tool with 170K+ GitHub Stars for running DeepSeek, Qwen, Gemma and other LLMs locally. Learn installation, supported models, use cases and core advantages.
Read more →
Tutorials·3 min
Ollama Tutorial: The Open-Source Tool for Running DeepSeek and Other LLMs Locally with One Click
Complete guide to running LLMs locally with Ollama. Supports DeepSeek, Qwen, Gemma and more. 170K+ GitHub Stars, zero-config setup, full data privacy, no per-token API fees.
Read more →
Product Reviews·5 min
AnythingLLM: A Locally Deployed Open-Source AI Knowledge Base — The Privacy-First RAG Powerhouse
Deep dive into AnythingLLM: a privacy-first, locally deployed open-source AI tool with RAG, multi-model support, and vector databases. 59K+ GitHub Stars, zero-config setup, ideal for enterprise knowledge bases.
Read more →