#Block Low-Rank decomposition
18 related articles
·3 min
DeepSeek-OCR Deployment & Fine-Tuning in Practice: From vLLM Inference to Unsloth Fine-Tuning
Complete guide to DeepSeek-OCR from vLLM inference deployment and Unsloth model loading to fine-tuning, covering cloud server setup, GPU selection, and code examples — all on a single 4090 GPU.
Read more →
·3 min
DeepSeek-OCR Deployment and Fine-Tuning: A Complete Hands-On Guide
Master the full DeepSeek-OCR deployment and fine-tuning workflow: vLLM inference deployment, efficient Unsloth fine-tuning, dataset preprocessing, LoRA training, validation, and RAG vector database integration.
Read more →
·8 min
LangChain Crash Course: A Complete Roadmap from Zero to Agent Development
A systematic roadmap from LangChain and LangGraph to multi-agent development, covering RAG, Tool Calling, MCP, and more, helping developers break into AI app development.
Read more →
·2 min
Complete uBlock Origin Filter Rules to Block Civitai Ad Banners
Custom uBlock Origin filter rules to precisely block Civitai's 'Support Civitai creators' ad banners and fix layout issues. Full rule code and setup steps for .com and .red domains.
Read more →
Block Low-Rank Compression: A Guide to…
·2 min
Block Low-Rank Compression: A Guide to Accelerating Large Model Inference on Memory-Constrained GPUs
Learn how Block Low-Rank (BLR) decomposition compresses large model memory usage and accelerates GPU inference, including CUDA kernel optimization and combination with quantization and pruning.
Read more →
·2 min
15-Year-Old Trains 200M MoE Language Model from Scratch: Full Architecture & Hands-On Breakdown
A 15-year-old trained Tiny-MoE, a 200M-parameter MoE language model from scratch using free Kaggle GPUs, featuring MLA attention, RoPE+YaRN, and native PyTorch.
Read more →
·7 min
Breaking Down the Core Skills of an AI Application Engineer: From Beginner to Industrial-Grade Deployment
Knowing how to call an API doesn't make you an AI engineer. This article breaks down the complete skill structure of an AI application engineer, covering Python fundamentals, LLM fine-tuning, Agent development, and enterprise projects.
Read more →
·6 min
Getting Started with AI Agents: Principles, Frameworks, and a Guide to Building Enterprise-Grade Agents
In-depth analysis of AI Agent core principles: why LLMs need Agent technology, the evolution from Prompt to RAG to Agent, Agent Tuning methods, and enterprise cost evaluation to help you build enterprise-grade agent applications.
Read more →
·5 min
Essential Math for AI/ML Research: Should Undergrads Choose the Specialist Sequence or the Major Track?
Aiming for AI/ML research? How should you pick undergrad math courses? This article breaks down linear algebra, probability & statistics, and optimization, weighing the specialist sequence vs. the Major track.
Read more →
·5 min
Runs on Low VRAM! A Hands-On Look at the ID LoRA Face-to-Video Workflow
A face-to-video workflow built on GGUF quantized models and ID LoRA runs on just an RTX 3060 with 6GB VRAM. This article breaks down its core principles, four-step process, and how it tackles facial consistency in AI video.
Read more →
·5 min
Why Did Ollama Rise So Fast? Decoding the Success of a Local LLM Tool
How did Ollama grow from a niche open-source project into developers' default choice for running local LLMs? This article breaks down its rise across product design, technical strategy, and ecosystem building.
Read more →
·5 min
DeepSeek Boosts Inference Speed by 85%: How Speculative Decoding Is Reshaping the AI Speed Race
DeepSeek and Peking University's DS Spark paper boosts AI inference speed by up to 85% via confidence scheduling and semi-autoregressive speculative decoding — no model or GPU changes.
Read more →
·6 min
7 Anima Model Combinations Tested: The Optimal Config Guide for Anime Image Generation
A Reddit user's rigorous controlled experiment testing all 7 Anima combos—base, aesthetic, turbo LoRA, and turbo baked. Key takeaway: choose aesthetic first, add Turbo LoRA for anime-girl style. Includes prompt structures and ComfyUI configs.
Read more →
·7 min
Complete Guide to Training Small Models on Kaggle's Free Compute: GPU Quotas and Practical Tips
In-depth guide to Kaggle's free-tier compute: P100/T4 GPU with 30 hours/week quota, 12-hour sessions, suitable models like CNN and BERT fine-tuning, plus tips like mixed precision and checkpointing to start deep learning at zero cost.
Read more →
·6 min
Introduction to Prompt Engineering: A Complete Guide from Understanding to Implementation
Prompt engineering is more than messaging AI. This guide breaks down the four core functions of prompts, the six-step prompt engineering process, and key limitations to help you build the right foundation.
Read more →
·6 min
Unsloth Major Update: DeepSeek-V4 Support and a Deep Dive into NVFP4 Quantized Export
Unsloth v0.1.481-beta adds full DeepSeek-V4-Flash support, NVFP4/FP8/imatrix GGUF quantized export, 1.3x faster GRPO, 3-5x faster MoE training, and an OpenAI-compatible API service in Studio.
Read more →
·5 min
Embedded Linux vs. AI Agent Development: A Comprehensive Comparison of Salary, Job Availability, and Career Stability
Embedded Linux or AI Agent development? This in-depth comparison covers salary, job availability, and career stability to help developers pick the right path.
Read more →
·3 min
AI Large Language Model Zero-to-Hero Systematic Tutorial: A Complete Guide from Basics to Practice
A comprehensive 748-episode AI LLM tutorial covering Transformer architecture, Prompt Engineering, RAG, Agent, fine-tuning, and enterprise projects like AI customer service and knowledge bases.
Read more →