#local inference
1964 related articles
Product Reviews·3 min
Cube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Read more →
Tutorials·2 min
Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training
Learn how Unsloth enables efficient local LLM fine-tuning with LoRA optimization, supporting Gemma 4, Qwen3, and DeepSeek while reducing VRAM usage by 50% and boosting training speed 2-5x.
Read more →
Product Reviews·1 min
Unsloth: An Efficient Open-Source Tool for Local LLM Fine-Tuning
Unsloth is a 63,000+ star open-source project on GitHub with a Web UI for locally training and fine-tuning LLMs like Gemma 4, Qwen3, and DeepSeek on consumer GPUs.
Read more →
Product Reviews·3 min
GitHub 8000+ Stars: A Deep Dive into awesome-LLM-resources — The Most Comprehensive Large Language Model Resource Collection
Deep dive into the GitHub 8000+ star project awesome-LLM-resources, covering LLM training, multimodal generation, AI Agents, MCP protocol, AI-assisted coding, and more for developers.
Read more →
Tutorials·3 min
Ollama Tutorial: The Complete Guide to Running Large Models Locally (2025 Updated)
Complete guide to deploying LLMs locally with Ollama. Supports DeepSeek, Qwen, Kimi-K2.5 and more. 170K GitHub Stars, one-click install, full data privacy, zero API costs.
Read more →
Tutorials·2 min
Ollama Tutorial: Complete Guide to Running DeepSeek, Qwen, and Other LLMs Locally with One Click
Complete guide to Ollama: install and run DeepSeek, Qwen, Kimi-K2.5, GLM-5 and more LLMs locally. 170K+ GitHub Stars, the most popular local LLM framework for offline AI inference and privacy.
Read more →
Tech Frontiers·1 min
LLM 0.32a1 Released: Critical Bug Fix for Tool-Calling Conversation Recovery
Simon Willison releases LLM CLI tool v0.32a1, fixing a critical bug where tool-calling conversations couldn't be properly restored from SQLite database.
Read more →
Tech Frontiers·3 min
Osaurus: A Native macOS Offline AI Agent Framework — 5,000+ Star Open Source Project Deep Dive
Deep dive into Osaurus — a native macOS AI agent framework supporting fully offline operation, persistent memory, cryptographic identity, and arbitrary model integration. Built with Swift and C for Apple Silicon. 5,100+ GitHub stars.
Read more →
Product Reviews·1 min
AIChat: A Deep Dive into the All-in-One LLM Command-Line Tool Built with Rust
AIChat is a Rust-based all-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, and AI Agents with support for OpenAI, Claude, Gemini, and more.
Read more →
Product Reviews·1 min
Unsloth: A Powerful Tool for Training Open-Source LLMs Locally
Unsloth is an open-source tool with 63K+ GitHub stars that provides a Web UI for locally training and running LLMs like Gemma 4, Qwen3.6, and DeepSeek.
Read more →
Product Reviews·1 min
Cube Studio: Deep Dive into Tencent's Open-Source Cloud-Native All-in-One AI Platform
Deep dive into Cube Studio, Tencent's open-source cloud-native AI platform covering the full MLOps lifecycle from data labeling to large model training and inference deployment.
Read more →
Product Reviews·1 min
nanobot: Ultra-Lightweight Personal AI Agent Goes Viral on GitHub
nanobot, an ultra-lightweight personal AI Agent from HKUDS, has gone viral on GitHub with 41K+ Stars. Learn why this minimalist framework is reshaping the AI Agent landscape.
Read more →
Product Reviews·1 min
Unsloth: A Powerful Tool for Locally Training and Running Open-Source LLMs
Unsloth is an open-source tool with 63K+ GitHub stars for locally training and running LLMs like Gemma 4, Qwen3.6, and DeepSeek with optimized VRAM usage.
Read more →
Product Reviews·2 min
OpenYak: Open-Source Local AI Agent Supporting 100+ Models with Zero Telemetry Privacy
OpenYak is an open-source local AI agent supporting Windows/macOS/Linux. Access 100+ models via OpenRouter, MCP, and Ollama with BYOK zero-telemetry privacy — a strong alternative to Claude Code and OpenAI Codex.
Read more →
Product Reviews·2 min
NadirClaw: Open-Source LLM Router That Automatically Saves 40-70% on AI API Costs
NadirClaw is an open-source, self-hosted LLM router that automatically routes simple tasks to cheap models and complex tasks to premium ones, saving 40-70% on AI API costs with OpenAI-compatible proxy support.
Read more →
Tutorials·3 min
Ollama Tutorial: The Simplest Way to Run DeepSeek and Other LLMs Locally
Complete guide to deploying LLMs locally with Ollama. Supports DeepSeek, Qwen, Kimi-K2.5 and more. Learn how this 170K-Star open-source tool enables one-click setup, offline inference, and ecosystem integration.
Read more →
Product Reviews·2 min
The Complete Guide to AnythingLLM: A Privacy-First AI Productivity Tool for Local Deployment
Deep dive into AnythingLLM, a privacy-first open-source AI tool for local deployment. Covers RAG document chat, multi-model support, AI Agents, and more — zero config, nearly 60K GitHub Stars.
Read more →
Product Reviews·4 min
Cube Studio: Tencent's Open-Source All-in-One AI Platform Covering the Full Pipeline from Large Model Training to Inference
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning, vLLM inference, VGPU virtualization, and Huawei Ascend adaptation.
Read more →
Product Reviews·2 min
Chatbox: A Detailed Look at the Open-Source Multi-Model AI Desktop Client
Chatbox is an open-source AI client with nearly 40K GitHub Stars, supporting ChatGPT, Claude, Gemini and local models with cross-platform desktop apps, local data storage, and Prompt management.
Read more →
Product Reviews·2 min
OpenCodesign: Open-Source AI Design Tool with Multi-Model Support as a Claude Design Alternative
OpenCodesign is an open-source AI design tool supporting Claude, GPT, Gemini, and more models. With local-first architecture and BYOK mode, it generates prototypes, slides, and PDFs from natural language prompts. 5000+ GitHub Stars.
Read more →