#Ollama AMD GPU

36 related articles

Jul 6, 2026·3 min

Running Local LLMs on AMD GPUs: Ditching Ollama for LM Studio Delivers 7x Speed Boost

AMD GPU black screens running local LLMs? This post-mortem covers Ollama's 3 fatal flaws and how switching to LM Studio boosted token speed from 5 to 36, with ROCm setup, Speculative Decoding, and GFX version tips.

Aug 3, 2026·3 min

Locally Deploying LLMs for Trading Bots: Hardware Selection & Model Recommendations

How to deploy LLMs locally on AMD RX 7800 XT 16GB for trading bots: ROCm ecosystem, 7B-14B model picks (Qwen2.5, Llama 3.1), Ollama/LM Studio setup, and system architecture design.

Aug 2, 2026·4 min

Multi-Purpose Home Server Build Guide: Streaming + AI Inference + App Hosting on One Machine

How to build a $500 multi-purpose home server for Jellyfin streaming, Ollama local AI inference, web app hosting, and Pi-hole ad blocking with dual RTX 3060 GPUs.

Jul 30, 2026·3 min

OpenWorker: A Free, Open-Source Local AI Agent That Keeps Your Data at Home

OpenWorker is a free, open-source desktop AI agent that runs locally, supports bring-your-own-model, and keeps your data private. Learn about its local-first design philosophy and key differentiators.

Jul 30, 2026·3 min

OpenWorker: A Free, Open-Source Local AI Agent That Keeps Your Data at Home

OpenWorker is a free, open-source desktop AI agent that runs locally, supports bring-your-own-model, and keeps your data private. Learn about its design philosophy and key differentiators.

Jul 27, 2026·2 min

RX 9060 XT vs RTX 5060 Ti: Which GPU to Pick for Local AI?

RX 9060 XT vs RTX 5060 Ti — both 16GB VRAM, but which is better for local AI? We compare CUDA ecosystem, ROCm compatibility, LLM inference, and real-world usability.

Jul 27, 2026·2 min

RX 9060 XT vs RTX 5060 Ti: How to Choose a GPU for Local AI

RX 9060 XT vs RTX 5060 Ti both offer 16GB VRAM — which is better for local AI inference? A full comparison of CUDA ecosystem, ROCm compatibility, LLM performance, and real-world usability.

transcribe.cpp: A Unified Speech Recog…

Jul 21, 2026·2 min

transcribe.cpp: A Unified Speech Recognition Engine Built on ggml, Supporting 16+ Model Families

transcribe.cpp is an open-source ggml-based speech recognition engine supporting 16+ model families in a single C++ codebase — lightweight, cross-platform, and quantization-ready for local STT.

Jul 19, 2026·4 min

AMD Ryzen AI Halo Real-World Test: Can a Non-Programmer Use Local AI to Write Code?

A non-programmer tests AMD Ryzen AI Halo by deploying local AI models to tackle a real dev task. After testing Ollama and Qwen3, the verdict: AI amplifies developers, it doesn't replace them.

Jul 16, 2026·2 min

llama.cpp Milestone: The Open-Source Evolution of Local LLM Inference

llama.cpp hits a new milestone, growing from a solo hobby project into core local AI inference infrastructure. Explore its iteration speed, GGUF quantization, and how AI coding agents are reshaping open-source development.

Building an eGPU for Local LLM on a $1…

Jul 14, 2026·2 min

Building an eGPU for Local LLM on a $1,000 Budget: A Practical Buying and Setup Guide

Building an eGPU for local LLMs on a $1,000 budget? This guide covers GPU selection, dock costs, RTX 3090 vs 3060 value, and top tools like Ollama and llama.cpp.

Jul 13, 2026·3 min

Local Gemma 3 12B as an AI Agent: A Practical Guide to Tool Calling and Framework Selection

Running Gemma 3 12B locally via Ollama and want to build an AI Agent? This guide covers tool calling, n8n/LangChain/CrewAI comparisons, context limits, and more.

Jul 12, 2026·4 min

AMD Ryzen AI Halo Hands-On: Can x86 Architecture Challenge NVIDIA's DGX Spark?

In-depth review of the AMD Ryzen AI Halo mini AI box: powered by the Ryzen AI Max Plus 395 (Strix Halo) chip with 128GB unified memory, priced at $4,000. Compared against NVIDIA's DGX Spark across token generation, prefill speed, and x86 advantages.

Jul 11, 2026·4 min

Demystifying Unified Memory Architecture: How Mini PCs Run 70B Large Models

Why can a mini PC with unified memory run a 70B model while an RTX 4090 can't? A deep dive into the VRAM wall and unified memory architecture for smarter local AI hardware choices.

Jul 11, 2026·5 min

Why Did Ollama Rise So Fast? Decoding the Success of a Local LLM Tool

How did Ollama grow from a niche open-source project into developers' default choice for running local LLMs? This article breaks down its rise across product design, technical strategy, and ecosystem building.

Jul 9, 2026·6 min

AMD Ryzen AI Halo Dev Kit: A $4,000 Local LLM Powerhouse Taking on Apple and NVIDIA

AMD officially unveils the Ryzen AI Halo local AI dev kit, priced around $4,000 with 128GB unified memory, capable of running 70B LLMs locally. An in-depth look at its specs, pricing, and market competition.

Jul 8, 2026·7 min

Ollama + Hermes Local AI Deployment: Building a 100% Private Personal AI Operating System

Build a fully private local AI system with Ollama + Hermes: zero cost, no rate limits, data stays local. Learn deployment steps, model selection tips, and private/cloud hybrid workflows.

Jul 8, 2026·2 min

Unsloth v0.1.45 Released: Gemma 4 MTP Acceleration, Cross-Platform Fixes, and Studio Upgrades

Unsloth v0.1.45-beta adds Gemma 4 MTP support, AMD ROCm & NVIDIA Blackwell fixes, a new Hub download manager, and a compact RAG system for local LLM fine-tuning.

Jul 6, 2026·6 min

A 284B Model Running on a MacBook: The Real Breakthrough and Barriers of Local DeepSeek Inference

Redis creator runs 284B-parameter DeepSeek model on a MacBook Pro at 26 tokens/sec using a pure C engine, asymmetric quantization, and MoE architecture.

Jun 27, 2026·4 min

The Complete Guide to Running GLM-5.2 Locally with 4 RTX 3090s for $4,000

How to build a local AI inference server with 4 used RTX 3090 SXM4 GPUs to run GLM-5.2 via Llama.cpp and Unsloth IQ quantization, with real benchmarks on speed and quality.