#Ollama engineering runtime

145 related articles

Jul 26, 2026·4 min

Spring AI 2.0: Five Key Updates Explained — Stepping into the Agent Era

Spring AI 2.0 brings five core updates: mandatory upgrade to Spring Boot 4, lifted Tools parsing, built-in Agentic mechanism, MCP switch to Streamable HTTP, and an on-demand tool-loading Advisor.

Jul 25, 2026·6 min

How the Creator of Redis Squeezed a 284B-Parameter DeepSeek into an Ordinary Laptop

Redis creator antirez built DS4 "Dwarf Star," a pure-C inference engine, using asymmetric quantization to compress DeepSeek V4 Flash from 500GB to 80.8GB for local 128GB unified-memory deployment at 26.7 tokens/sec.

Jul 25, 2026·6 min

How the Creator of Redis Squeezed a 284-Billion-Parameter DeepSeek Into an Ordinary Laptop

Redis author antirez built the pure-C inference engine DS4 "Dwarf Star," compressing DeepSeek V4 Flash from 500GB to 80.8GB via asymmetric quantization for local deployment on 128GB unified memory at 26.7 tokens/sec.

Alibaba Open-Sources Code Review Tool …

Jul 24, 2026·5 min

Alibaba Open-Sources Code Review Tool open-code-review: Deterministic Pipeline + LLM Dual-Engine Analysis

Alibaba open-sources code review tool open-code-review, using a hybrid architecture of deterministic rule pipelines and LLM Agents. Supports line-level comments, OpenAI/Anthropic APIs, battle-tested at Alibaba scale, written in Go, fully free and open-source.

Jul 24, 2026·4 min

Spring AI 1.0 Practical Guide: A Java Developer's Fast Track to Building AI Applications

Spring AI 1.0 is here — Java developers can now build AI apps without switching to Python. This guide covers LLM integration, RAG, intelligent customer service, and Agent patterns for enterprise deployment.

Jul 24, 2026·4 min

Dify Local Deployment Guide: One-Click Private AI Platform with Docker

Step-by-step guide to deploying Dify AI platform locally with Docker. Covers Linux, Windows, macOS setup, docker compose launch, and first-time initialization in under 30 minutes.

Jul 22, 2026·2 min

Agent A1 Open Source: 35B MoE Local Inference Speed Test & Deployment Guide

Agent A1 is a 35B MoE open-source model from Shanghai's Intern Science, activating only 3B params. Hits 95 tok/s on M4 Mac Studio. Supports 256K context, tool calling, and free local deployment via Ollama.

llmfit: One Command to Check Which Loc…

Jul 22, 2026·2 min

llmfit: One Command to Check Which Local LLMs Your Hardware Can Run

llmfit is an open-source Rust CLI tool that predicts whether your local hardware can run a given LLM — no model download required. Covers hundreds of models and backends like Ollama and llama.cpp.

Jul 22, 2026·3 min

Dify for Beginners: A Complete Guide to Building AI Applications

A beginner's guide to Dify covering Docker deployment, MySQL setup, model integration, five app types (Chatbot/Agent/Workflow), and publishing — build LLM apps fast.

Jul 22, 2026·3 min

Dify Getting Started: A Complete Zero-to-Production Guide for Building AI Applications

A complete guide to Dify — covering deployment, five core app types (chatbot, Agent, workflow, and more), LLM integration, and publishing for zero-experience developers.

Jul 20, 2026·3 min

lx: 72 Local CLI Tools That Bring Ollama Models Into Your Terminal

lx is a set of 72 single-purpose CLI tools running on local Ollama models — no API key, fully offline. Supports git commit generation, log debugging, and more. Rust binaries with <15ms cold start; 7–8B models work great.

AIRI: The Open-Source Self-Hosted AI C…

Jul 20, 2026·2 min

AIRI: The Open-Source Self-Hosted AI Companion to Build Your Own Cyber Neuro-sama

AIRI (moeru-ai/airi) is an open-source, self-hosted AI companion with real-time voice chat, Minecraft/Factorio gameplay, and Web/macOS/Windows support. 42K+ GitHub stars.

Open Interpreter: A Local Coding Agent…

Jul 20, 2026·2 min

Open Interpreter: A Local Coding Agent Built for Low-Cost Models

Open Interpreter is an open-source coding agent optimized for low-cost and local models like Llama and Qwen. 65K+ GitHub Stars, privacy-first, no expensive APIs required.

Jul 19, 2026·2 min

Ollama Modelfile in Practice: Deploy Your Own Custom DeepSeek-R1 Model Locally

Step-by-step guide to wrapping DeepSeek-R1 with an Ollama Modelfile — set temperature, system prompts, and run fully offline for privacy and flexibility.

Jul 19, 2026·2 min

BatonBot: An Open-Source Kanban Tool for Managing AI Coding Agents

BatonBot is a local-first open-source kanban tool built for AI coding agents. Features prompt queuing, pipelines, Jira integration, and multi-model support.

Jul 19, 2026·3 min

Zero-Cost VibeCoding: Complete Guide to Connecting Local Ollama Models to Codex

Step-by-step guide to running local open-source models (Qwen3/Gemma) with Ollama, connecting to Codex via CC Switch for zero-token AI coding. Works on a 6GB VRAM laptop.

Jul 19, 2026·3 min

The Complete Ollama Guide: The Simplest Way to Run LLMs Locally

Ollama has 9M active developers and 170K GitHub stars. This guide covers its features, architecture, business model, and use cases for running LLMs locally.

Jul 17, 2026·2 min

Text-Only Models Controlling a Linux Desktop: Inside PawFlow's Dual-Model Architecture

PawFlow decouples vision and reasoning into two models, letting a text-only LLM reliably control a Linux desktop. A deep dive into its dual-model architecture, pre-click guard, and caching strategy.

Jul 17, 2026·3 min

Complete Guide to Deploying LLMs Locally on RobotCore Mini: From Ollama Installation to Web Interface Setup

A complete guide to deploying LLMs locally on RobotCore Mini using Ollama — covering model pulling, CLI verification, Web backend setup, and LAN access.

Jul 17, 2026·3 min

Waku Agent Deep Dive: The Four Core Pillars of a Local-First AI Assistant

A deep dive into Waku Agent's four pillars: Loop Engineering, three-tier Memory system, Eval assessment, and the Harness scaffold. Full walkthrough of a local-first AI assistant from task execution to memory consolidation.