#CUDA programming
128 related articles
·1 min
Getting Started with Ollama: The Best Tool for Running Open-Source LLMs Locally
Ollama is a free, open-source local LLM platform supporting macOS, Windows, Linux, and Docker. Easily deploy DeepSeek and other open-source models with API and CLI support — no complex GPU setup required.
Read more →
Nvidia: From Chip Supplier to the Capi…
·2 min
Nvidia: From Chip Supplier to the Capital Hub Behind the AI Boom
Nvidia is more than a GPU giant — it operates as the financial backbone of the AI boom through investment and capital recycling. A deep analysis of the risks.
Read more →
·6 min
A 284B Model Running on a MacBook: The Real Breakthrough and Barriers of Local DeepSeek Inference
Redis creator runs 284B-parameter DeepSeek model on a MacBook Pro at 26 tokens/sec using a pure C engine, asymmetric quantization, and MoE architecture.
Read more →
·5 min
The Complete Guide to OpenCode: Installation, Configuration, and Advanced Usage
A comprehensive guide to OpenCode, the open-source AI coding tool — covering installation (desktop/WSL), model config, rules files, custom commands, MCP extensions, and Agent SQL capabilities.
Read more →
·3 min
Qwythos-9B Hands-On Review: Deploying an Uncensored Open-Source Model That Inherits Claude's Reasoning Abilities
Hands-on review of Qwythos-9B, distilled from 500M+ Claude reasoning traces. Supports 1.04M token context, uncensored, runs on just 4GB VRAM. Full deployment guide included.
Read more →
·3 min
The Ultimate Ollama Guide: A Complete Walkthrough for Running AI Models Locally
Complete Ollama guide: install and run open-source LLMs like DeepSeek, Llama, and Qwen locally on Windows/Mac/Linux. Free, private, and beginner-friendly.
Read more →
·3 min
Making LLMs Faster and Lighter: A Practical Approach to Reshaping Sparsity for GPUs
Deep dive into Sakana AI and NVIDIA's latest research using TwELL sparse packing format and custom CUDA kernels to convert LLM sparsity into real GPU speedups, achieving 20%+ faster inference/training and significantly lower memory usage.
Read more →
·3 min
DAQIRI Platform Explained: Deep Integration of High-Speed Data Acquisition and Real-Time AI Inference
Deep dive into how the DAQIRI platform embeds NVIDIA GPU-accelerated computing into high-speed data acquisition pipelines, enabling real-time AI inference for industrial inspection, scientific experiments, and autonomous driving.
Read more →
·1 min
OpenFugu: An Open-Source Experiment Reimplementing Sakana AI's Fugu Ultra Model in Zig
OpenFugu is an open-source project reimplementing Sakana AI's Fugu Ultra model in Zig, exploring non-mainstream systems languages in AI development.
Read more →
·4 min
Llama.cpp Windows Local Deployment Guide: Run LLMs in Three Steps Without Compiling
Step-by-step guide to deploying Llama.cpp on Windows without compiling. Download pre-built packages, configure CUDA, and run GGUF quantized models locally with GPU acceleration and web UI in three simple steps.
Read more →
·3 min
Spring AI + Ollama: Run Large Language Models Locally at Zero Cost
Learn how to integrate Spring AI with Ollama to run open-source LLMs like Llama and Gemma locally for free. Covers setup, configuration, and code — switch from OpenAI by just changing dependencies.
Read more →
·3 min
ThundeRobot Hunter Blade S 2026 Review: i9-13900HX + RTX 5060 Configuration Analysis & Buying Guide
In-depth review of the ThundeRobot Hunter Blade S 2026 with i9-13900HX and RTX 5060 16GB. Analyzing CPU/GPU performance, AI capabilities, and value at ~6,671 RMB after subsidies.
Read more →
·4 min
Local Deployment of Claude Code: Principles and Practical Guide for Three Approaches
A detailed guide to locally deploying Claude Code with three approaches (LM Studio, Ollama, vLLM), covering architecture, protocol translation, hardware selection, and model recommendations.
Read more →
·2 min
DiffusionGemma: Google's Open-Source Diffusion Language Model Exceeding 500 Tokens/s
Google releases DiffusionGemma, an open-source diffusion language model with Apache 2.0 license. The 26B-parameter MoE model achieves over 500 tokens/s in real-world tests.
Read more →
·3 min
Xiaomi MIMO vs. Huawei Pangu AI Strategy Comparison: The Android vs. iOS Battle of the Agent Era
Xiaomi releases open-source MIMO Code while Huawei enters the Agent era with Pangu. Compare their AI strategies: Xiaomi's Android-like open ecosystem vs. Huawei's iOS-like vertical integration.
Read more →
·3 min
Gemma 4 Open-Source Model Local Deployment Guide: Ollama Installation & Mobile Setup
Step-by-step guide to deploying Google's Gemma 4 open-source model locally with Ollama and running the lightweight version on mobile with tool calling support.
Read more →
·3 min
The Complete Guide to DeepSeek TUI: Installation, Configuration, and Hands-On Use of a Terminal AI Coding Agent
A deep dive into DeepSeek TUI: the terminal AI coding agent with chain-of-thought visualization, million-token context, and multi-task parallelism. Covers installation, configuration, and real-world use cases.
Read more →
·4 min
Getting Started with Huawei Ascend C Operator Programming: Kernel Functions and Hands-On Development Guide
A systematic guide to Huawei Ascend C operator programming covering kernel functions, three-stage pipeline paradigm, API categories, and a hands-on AddCustom operator walkthrough.
Read more →
·4 min
Cursor Composer2 Training Revealed: A Complete Guide to Distributed Reinforcement Learning Engineering
Deep dive into how Cursor trained Composer2: two-stage architecture, global distributed clusters, MOE numerical alignment, simulation anti-cheating, and more.
Read more →
·3 min
PyTorch Beginner's Guide: A Complete Analysis of Deep Learning Framework Selection and Evolution
A comprehensive analysis of why PyTorch became the most mainstream deep learning framework. Covers framework history, comparisons with TensorFlow and Keras, dynamic graphs, Tensors, installation guide, and cloud trends.
Read more →