#Llama
1630 related articles
·3 min
Running Local LLMs on AMD GPUs: Ditching Ollama for LM Studio Delivers 7x Speed Boost
AMD GPU black screens running local LLMs? This post-mortem covers Ollama's 3 fatal flaws and how switching to LM Studio boosted token speed from 5 to 36, with ROCm setup, Speculative Decoding, and GFX version tips.
Read more →
·2 min
Ollama: The 175K-Star Tool for Running Local LLMs with One Command
Ollama is an open-source local LLM runner with 175K+ GitHub Stars. Built in Go, it supports Llama, Mistral, Qwen and more — deploy in 3 steps, no setup headaches.
Read more →
·3 min
The Ultimate Ollama Guide: A Complete Walkthrough for Running AI Models Locally
Complete Ollama guide: install and run open-source LLMs like DeepSeek, Llama, and Qwen locally on Windows/Mac/Linux. Free, private, and beginner-friendly.
Read more →
·4 min
Llama.cpp Windows Local Deployment Guide: Run LLMs in Three Steps Without Compiling
Step-by-step guide to deploying Llama.cpp on Windows without compiling. Download pre-built packages, configure CUDA, and run GGUF quantized models locally with GPU acceleration and web UI in three simple steps.
Read more →
·3 min
Spring AI + Ollama: Run Large Language Models Locally at Zero Cost
Learn how to integrate Spring AI with Ollama to run open-source LLMs like Llama and Gemma locally for free. Covers setup, configuration, and code — switch from OpenAI by just changing dependencies.
Read more →
·3 min
Gemma 4 Open-Source Model Local Deployment Guide: Ollama Installation & Mobile Setup
Step-by-step guide to deploying Google's Gemma 4 open-source model locally with Ollama and running the lightweight version on mobile with tool calling support.
Read more →
·2 min
LlamaFactory: A Comprehensive Guide to the Open-Source Framework for Unified Fine-Tuning of 100+ LLMs
Deep dive into LlamaFactory, an open-source unified fine-tuning framework supporting 100+ LLMs and VLMs with LoRA, QLoRA, RLHF methods, Web UI, 71K+ GitHub Stars, accepted at ACL 2024.
Read more →
Tutorials·2 min
Ollama Getting Started Guide: The Best Tool for Locally Deploying Open-Source LLMs
A detailed guide to Ollama's core features: free open-source local LLM management with cross-platform support, intelligent GPU/CPU scheduling, and API integration for running DeepSeek and other open-source models locally at zero cost.
Read more →
Tutorials·2 min
Ollama Local LLM Deployment: From Installation to Conversation in Three Steps
Learn how to deploy LLMs locally with Ollama in three simple steps: install, choose a model, and run. No coding required, supports offline use, and completely free.
Read more →
Tutorials·3 min
Ollama + Gemma 4 Local Codex Setup: Complete Guide to Zero-Cost AI Programming
Learn how to run Codex locally with Ollama and Gemma 4 for zero-cost AI programming. Covers installation, model selection, and real demos as an alternative to $20-200/month paid plans.
Read more →
Product Reviews·3 min
Google Gemma 4 Hands-On Review: Offline on Smartphones + Ollama Deployment Tutorial
Hands-on testing of Google Gemma 4 open-source models running offline on three phones, with Dense vs MOE architecture explained and a complete Ollama + Claude Code deployment tutorial.
Read more →
Tutorials·3 min
llama.cpp MTP Acceleration Deployment Guide: Configuration Steps & Real-World Benchmarks
Guide to enabling MTP multi-Token prediction acceleration in llama.cpp, covering CUDA setup, desktop configuration, model selection, and benchmarks showing ~60 Token/s with Qwen3 27B.
Read more →
Tutorials·4 min
Practical Guide to Building a Local AI Knowledge Base with Qwen3.5 + RAGFlow + Ollama
Step-by-step guide to building a local RAG knowledge base using RAGFlow, Ollama, and LM Studio with Docker, covering Embedding model deployment and network troubleshooting for private AI Q&A.
Read more →
Tutorials·4 min
Complete Guide to Building a Local AI Knowledge Base with Qwen3.5 + RAGFlow + Ollama
Complete guide to building a local AI knowledge base with Qwen3.5, RAGFlow, and Ollama, covering Docker deployment, Embedding model configuration, knowledge base creation, and RAG system setup.
Read more →
Product Reviews·3 min
Llama 3.3 70B In-Depth Review: Testing the Strongest Open-Source LLM with 13 Questions
Meta releases Llama 3.3 70B open-source model with just 70B parameters rivaling 405B performance. Tested on 13 logic, math, and coding questions, it passed 12 — reshaping the open-source model landscape.
Read more →
Tutorials·2 min
Complete Guide to Local LLM Deployment with Ollama: AI That Works Offline
Complete guide to deploying open-source LLMs locally with Ollama. Covers installation, model selection, VRAM requirements, and performance comparison of Llama 3 and Qwen models. Free, offline-capable AI.
Read more →
Tutorials·1 min
Ollama Local LLM Deployment Tutorial: Complete Guide from Installation to API Integration
Complete guide to deploying open-source LLMs locally with Ollama, covering installation, model selection, quantization strategies, Python API integration, and performance optimization tips.
Read more →
Tutorials·2 min
Use Claude Code for Free: CC Switch + Ollama Local Model-Powered AI Programming Agent Tutorial
Tutorial on using CC Switch to disguise local Ollama models as Claude API, driving Claude Code desktop for free AI programming with Qwen, Gemma, and other open-source models.
Read more →
Tutorials·2 min
DeepSeek Local Deployment Tutorial: One-Click Install & Run with Ollama
Learn how to deploy DeepSeek R1 locally using Ollama with this step-by-step guide covering installation, model selection, hardware requirements, and advanced features like GUI and knowledge bases.
Read more →
Industry Insights·2 min
Enterprise LLM Selection Guide: In-Depth Comparison of Llama 3.1, Qwen 2.5, and DeepSeek
How should enterprises choose open-source LLMs? This guide compares Llama 3.1, Qwen 2.5, DeepSeek, and Mistral across model capabilities, hardware requirements, and business scenarios.
Read more →