[KongchangAI]

#Ollama

100 related articles

Ollama v0.35.0-rc1 Released: MLX Pull Retry Optimization
·1 min

Ollama v0.35.0-rc1 Released: MLX Pull Retry Optimization

Ollama v0.35.0-rc1 is out, featuring improved MLX backend pull retry logic with bounded retries and a watchdog mechanism to prevent stalled model downloads on Apple Silicon.

Read more →
Ollama v0.35.0-rc0 Released: Introduces System One Scoring API
·1 min

Ollama v0.35.0-rc0 Released: Introduces System One Scoring API

Ollama v0.35.0-rc0 is out, featuring a new System One Scoring API (PR #18606). Learn what changed, what RC means, and whether you should upgrade.

Read more →
Ollama v0.35.1-rc0 Update: Explicit Model Capability Declaration Mechanism Explained
·1 min

Ollama v0.35.1-rc0 Update: Explicit Model Capability Declaration Mechanism Explained

Ollama v0.35.1-rc0 introduces explicit model capability declarations via PR #18708, replacing fragile architecture metadata matching with clear capability contracts and paving the way for MLX runtime support.

Read more →
Ollama v0.35.1-rc1 Released: Adds Support for the Clef Model
·1 min

Ollama v0.35.1-rc1 Released: Adds Support for the Clef Model

Ollama v0.35.1-rc1 release candidate adds support for Clef, an audio-language model. Learn what changed, what Clef does, and why model support expansion matters.

Read more →
Ollama Releases v0.35.1-rc2: Continuous Iteration of the Local LLM Runtime Tool
·1 min

Ollama Releases v0.35.1-rc2: Continuous Iteration of the Local LLM Runtime Tool

Ollama releases v0.35.1-rc2, fixing a CI build context issue with a verified GPG signature. Learn what this release candidate means and why Ollama matters for local LLM users.

Read more →
Ollama Local LLM Deployment Guide: Run Models on Just 6GB VRAM
·2 min

Ollama Local LLM Deployment Guide: Run Models on Just 6GB VRAM

Learn how to deploy LLMs locally with Ollama — even on 6GB VRAM. Covers the truth about local DeepSeek, VRAM-based model selection, and a complete 4-step install guide.

Read more →
Moka Chat: One Command to Add MCP Tools to Your Ollama Models
·1 min

Moka Chat: One Command to Add MCP Tools to Your Ollama Models

Moka Chat is an MIT-licensed, local-first chat app. One npx command connects Ollama models to MCP tools, with Inspector showing JSON-RPC, token usage, and latency per call. Also supports LM Studio and hosted models.

Read more →
Run AI Locally on Mac: Complete Ollama Installation and Model Selection Guide
·2 min

Run AI Locally on Mac: Complete Ollama Installation and Model Selection Guide

Step-by-step guide to running free local AI on Mac: install Ollama, run DeepSeek in Terminal, set up Open WebUI with Docker, plus model recommendations by RAM.

Read more →
Getting Started with Local LLM Deployment: Ollama vs. vLLM for Deploying Qwen3
·2 min

Getting Started with Local LLM Deployment: Ollama vs. vLLM for Deploying Qwen3

A beginner's guide to local LLM deployment: comparing Ollama and vLLM, covering VRAM trade-offs, high concurrency, and deploying the qwen3-0.6B model with vLLM.

Read more →
Local Decision Models Come to Ollama: How Nimble Enables Real-Time Task Routing
·1 min

Local Decision Models Come to Ollama: How Nimble Enables Real-Time Task Routing

Ollama now supports local decision models. Nimble + the new /v1/systemone API enable real-time ticket triaging, model routing, and content moderation — all on-device.

Read more →
Ollama Tutorial: Run Open-Source AI Models Locally for Free — Complete Guide
·2 min

Ollama Tutorial: Run Open-Source AI Models Locally for Free — Complete Guide

Complete Ollama tutorial: install and run open-source AI models locally on macOS, Windows, or Linux for free. Covers local vs. cloud models, pricing, and Claude Code integration.

Read more →
Ollama Billing Bug: DeepSeek-V4.1-Flash Overcharge Fixed and Credits Restored
·1 min

Ollama Billing Bug: DeepSeek-V4.1-Flash Overcharge Fixed and Credits Restored

Ollama confirms a billing rate error on its deepseek-v4.1-flash model overcharged some users. Usage has been reset and overages refunded automatically. Here's what happened.

Read more →
Deep Dive into Ollama: How a 14-Person Team Built the Docker of AI Through Distribution
·3 min

Deep Dive into Ollama: How a 14-Person Team Built the Docker of AI Through Distribution

How Ollama's 14-person team built the Docker of AI through distribution. A deep technical breakdown of its dual inference backends, KV quantization, MTP speedups, real weaknesses, and what its true moat actually is.

Read more →
DeepSeek Local Deployment Guide: Ollama + API Calls Complete Tutorial
·2 min

DeepSeek Local Deployment Guide: Ollama + API Calls Complete Tutorial

Step-by-step guide to deploying DeepSeek locally with Ollama — covering hardware selection, model download commands, and three API call methods including the OpenAI-compatible interface.

Read more →
RTX 5060 Ti 16GB Local LLM Selection Guide: Ollama Model Recommendations and Benchmarks
·2 min

RTX 5060 Ti 16GB Local LLM Selection Guide: Ollama Model Recommendations and Benchmarks

What local LLMs can an RTX 5060 Ti 16GB run? A practical Ollama model selection guide covering VRAM limits, quantization, and recommendations for coding, reasoning, and image generation.

Read more →
Build a Fully Local AI Agent in Python in 10 Minutes
·2 min

Build a Fully Local AI Agent in Python in 10 Minutes

Learn how to build a fully local AI agent with Ollama and Pydantic AI in under 10 minutes using just a few dozen lines of Python — offline, free, and private.

Read more →
Import Local GGUF Models into Ollama: Share ComfyUI Models Without Re-Downloading
·1 min

Import Local GGUF Models into Ollama: Share ComfyUI Models Without Re-Downloading

Already downloaded a GGUF model in ComfyUI but re-downloading it in Ollama? This guide shows you how to import local GGUF models into Ollama via Modelfile to share models and skip redundant downloads.

Read more →
Ollama Beginner's Guide: Run Large Language Models Locally on Your Own Computer
·2 min

Ollama Beginner's Guide: Run Large Language Models Locally on Your Own Computer

Run LLMs locally with Ollama — fully offline, private, and free. This guide covers installation, CLI and Web UI usage, model download, and hardware requirements.

Read more →