#Vulkan compute

39 related articles

Aug 3, 2026·3 min

Locally Deploying LLMs for Trading Bots: Hardware Selection & Model Recommendations

How to deploy LLMs locally on AMD RX 7800 XT 16GB for trading bots: ROCm ecosystem, 7B-14B model picks (Qwen2.5, Llama 3.1), Ollama/LM Studio setup, and system architecture design.

Aug 3, 2026·3 min

Dual RTX 3060 Running DeepSeek V4 Flash: IQ2_M Quantized Inference Benchmarked at 3.5 tok/s

Benchmarking DeepSeek V4 Flash on dual RTX 3060 GPUs with 96GB RAM at IQ2_M quantization achieving 3.5 tokens/sec. Covers hardware choices, 2-bit quantization techniques, and local LLM deployment optimization.

Jul 30, 2026·3 min

LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec

Learn why memory bandwidth (GB/s)—not VRAM size—determines local LLM inference speed. Get the tokens/sec formula, GPU bandwidth comparisons, and a practical card selection hierarchy.

Jul 30, 2026·3 min

LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec

Why memory bandwidth (GB/s), not VRAM size, determines local LLM inference speed. Includes tokens/sec formula, GPU bandwidth comparison, and a practical card selection framework.

Jul 30, 2026·2 min

SDL_GPU: Deep Dive into a Single-Header High-Performance 2D Graphics Library

Deep analysis of the SDL_GPU single-header 2D graphics library covering its design philosophy, GPU acceleration principles, use cases, and technical trade-offs.

Jul 29, 2026·4 min

9 Hours, 4 Million Tokens: AI Creates a Stunning WebGPU Snow Rendering Masterpiece with Claude Code

Reddit user Noniv used Claude Code with the Opus model to build SNOWFLOW, a stunning WebGPU real-time snow renderer, in just 9 hours using 4 million tokens. A deep dive into prompt strategy, snow shaders, and performance optimization.

Jul 29, 2026·2 min

Running Manim in the Browser: Rebuilding 3Blue1Brown's Animation Engine with WebGPU

Explore how WebGPU brings 3Blue1Brown's Manim math animation engine to the browser, enabling zero-install, real-time mathematical visualization with interactive education potential.

Jul 28, 2026·3 min

ncnn Vulkan Cross-Platform Edge Inference in Practice: Solving the GPU Fragmentation Deployment Challenge

Facing GPU fragmentation on edge devices, the PostSlate team used ncnn's Vulkan backend for cross-platform ML inference, achieving 10× speedup on RTX 4070 with half the model size and zero runtime installation.

Jul 28, 2026·3 min

What Happens After You Click a Link? A Complete Technical Breakdown

From DNS resolution, TCP handshake, and TLS encryption to the Blink rendering engine — a detailed breakdown of what happens after you click a link.

Jul 28, 2026·3 min

Apple Silicon LLM Inference Speed Benchmarks: A Complete Guide to Local Large Model Performance on Mac

In-depth analysis of Apple Silicon local LLM inference speed benchmarks covering M-series memory bandwidth, model quantization, MLX framework optimization, and Mac configuration guidance.

Jul 27, 2026·3 min

Minecraft Java Edition Raises Recommended RAM to 16GB: What the Vulkan Migration Means

Minecraft Java Edition's recommended RAM jumps to 16GB as the game prepares for a Vulkan graphics API migration. Learn what this means for players and the mod ecosystem.

Jul 27, 2026·2 min

RX 9060 XT vs RTX 5060 Ti: How to Choose a GPU for Local AI

RX 9060 XT vs RTX 5060 Ti both offer 16GB VRAM — which is better for local AI inference? A full comparison of CUDA ecosystem, ROCm compatibility, LLM performance, and real-world usability.

Jul 27, 2026·2 min

RX 9060 XT vs RTX 5060 Ti: Which GPU to Pick for Local AI?

RX 9060 XT vs RTX 5060 Ti — both 16GB VRAM, but which is better for local AI? We compare CUDA ecosystem, ROCm compatibility, LLM inference, and real-world usability.

Jul 27, 2026·3 min

Dear ImGui Deep Dive: Why This Immediate Mode GUI Library Has Won Over C++ Developers

Deep dive into Dear ImGui's immediate mode GUI design, technical features, and use cases. Covers immediate vs retained mode, backend support, game engine integration, and ecosystem extensions.

Jul 27, 2026·3 min

Sebastian Lague's Custom Graphics Library: A Complete Breakdown of Building a Renderer from Scratch

Deep dive into Sebastian Lague's experiment building a graphics library from scratch, covering rasterization, depth buffering, texture mapping, and the educational value of software renderers.

Jul 16, 2026·3 min

Qwen3.5 Uncensored Version Local Deployment: Run a 35B Model on Just 6GB VRAM

Run Qwen3 35B-A3B uncensored locally on just 6GB VRAM using llama.cpp and GGUF quantization. Full deployment guide, code generation tests, and Agent integration walkthrough.

Jul 16, 2026·2 min

llama.cpp Milestone: The Open-Source Evolution of Local LLM Inference

llama.cpp hits a new milestone, growing from a solo hobby project into core local AI inference infrastructure. Explore its iteration speed, GGUF quantization, and how AI coding agents are reshaping open-source development.

Jul 15, 2026·4 min

Running Qwen3.6 27B Locally on a Single RTX 3090: A Complete Guide to Cloud-Rivaling Performance

One used RTX 3090, one 16.8GB GGUF file, and Qwen3.6 27B runs locally offline. SWE-bench score of 77 rivals Claude Sonnet. MTP boosts speed to 59 tok/s. Full local AI coding assistant deployment guide.

4 Alternatives for Running CUDA on Non…

Jul 15, 2026·3 min

4 Alternatives for Running CUDA on Non-NVIDIA Hardware: A Comparative Guide

A deep dive into running CUDA on non-NVIDIA hardware (AMD, Intel): comparing ROCm/HIP, ZLUDA, SYCL/oneAPI, and OpenCL across principles, use cases, and limitations.

Running Gemma LLM in Godot with GDScri…

Jul 14, 2026·2 min

Running Gemma LLM in Godot with GDScript and Vulkan: An Experimental Deep Dive

A developer runs the Gemma LLM inside Godot 4 using only GDScript and Vulkan compute shaders — no llama.cpp or external dependencies. A technical breakdown of how it works.