#GPU performance optimization
1000 related articles
·3 min
P.D.E Experiment Nº5: Deep Dive into the TouchDesigner Open-Source Multi-Source Video Playback System
Deep analysis of P.D.E Experiment Nº5 open-source multi-source video playback system, covering frame-accurate switching, multi-source scheduling, and TouchDesigner + generative AI workflows.
Read more →
·3 min
Hadamard Transform: A Deep Dive into the Lightweight Deep Learning Technique That Replaces Multiplication with Addition and Subtraction
Deep dive into how the Hadamard Transform replaces matrix multiplication with only addition and subtraction for lightweight deep learning, covering FWHT principles, edge inference acceleration, and ultra-low-bit LLM quantization.
Read more →
·3 min
The 5-Layer AI Tech Stack Explained: A Complete Industry Chain from Energy to Applications
Deep dive into the 5-layer AI tech stack: Energy, Chips, Infrastructure, Models, and Applications. Understand the key players, competitive landscape, and value distribution logic across the AI industry chain.
Read more →
·3 min
Quantprobe: An Open-Source Tool for Running 30B LLMs on 6GB GPUs
Quantprobe is an open-source memory optimization framework that enables 30B LLMs to run at 22 tokens/s on 6GB GPUs through per-layer quantization and intelligent CPU/GPU splitting.
Read more →
·3 min
GitHub Daily · August 5: AI Agents Enter the 'Production Engineering' Era
GitHub Trending Aug 5: AI Agents shift from demos to production with new projects for state management, long-term memory, skill systems, and security.
Read more →
·3 min
Fine-Tuning 8B LLMs on a 4GB GPU: A Deep Dive into VRAM Optimization Techniques
Learn how to fine-tune 8B parameter LLMs on a 4GB laptop GPU using QLoRA quantization, gradient checkpointing, and gradient accumulation VRAM optimization techniques.
Read more →
·2 min
Qwen3.8-Max Preview Continues Iterating with Major Improvements in Frontend Development Capabilities
Alibaba's Qwen3.8-Max-Preview iterates daily with significant frontend development improvements. The team uses an open preview strategy to collect community feedback, promising open-weight release.
Read more →
·2 min
Ollama Shifting from Local Deployment to Cloud Services? Community Controversy and the Open-Source Commercialization Dilemma
Ollama's recent brand shift from local LLM deployment to cloud API services sparks heated Reddit debate. Analyzing the capital logic, community concerns, and what open-source AI tool users should know.
Read more →
·4 min
SAM 3 Auto-Labeling in Practice: Six Lessons Where Preprocessing Matters More Than the Model
Practical lessons from building a SAM 3 auto-labeling pipeline: vision embedding reuse, resolution handling, prompt engineering, threshold sweeping, and more.
Read more →
·4 min
Running an 80B Large Model on Mac with Only 4.3GB of Memory: Extreme Compression Techniques Explained
Deep dive into how an 80B-parameter LLM runs on Mac with only 4.3GB memory, covering ultra-low-bit quantization, sparsity, memory mapping, and implications for privacy and edge AI.
Read more →
·4 min
A Beginner's Guide to Machine Learning: From Course Selection Confusion to a Systematic Learning Path
Confused by the overwhelming number of ML courses? This guide covers Udemy course evaluation, top free resources, and an actionable beginner learning path.
Read more →
·3 min
Xberg v1 Open-Source Document Extraction Engine: CPU-Only Local Processing Supporting 101 Formats
Xberg v1 is an MIT-licensed open-source local document extraction engine. CPU-only, supporting 101 formats with built-in SPLADE and ColBERT retrieval, Rust-powered for RAG and ML pipelines.
Read more →
·4 min
AI Engineer Growth Roadmap: From Programming Fundamentals to RAG and MCP Agent Development
A systematic AI engineer learning roadmap covering programming, math, ML, and data engineering foundations, plus frontier AI technologies like LLM, RAG, Agents, and MCP with free open-source resources.
Read more →
·2 min
Snapdown: A Local AI Tool for Mac That Converts Screenshots to Markdown with One Click
Snapdown is a local AI tool for Mac that converts screenshots to structured Markdown with one click, preserving headings, tables, and lists. Runs on Apple Silicon with no cloud dependency.
Read more →
·3 min
Walk on Decomposed Subdomains: A Mesh-Free Approach to Accelerating Monte Carlo PDE Solvers
Deep dive into Walk on Decomposed Subdomains, exploring how subdomain decomposition accelerates Monte Carlo PDE solving and improves WoS convergence in complex geometries.
Read more →
·3 min
Hand Wave: Real-Time Sign Language Translation on Meta Smart Glasses for Barrier-Free Communication
Hand Wave uses Meta smart glasses' camera and open-source AI neural networks to translate sign language into text and speech in real time, supporting iOS and Web platforms.
Read more →
·3 min
AI Tool Mashups in Practice: Combining Model Layering with Intelligent CLI
Explore AI development tool mashups: model layering with DeepSeek Flash, flagship model selection, Antigravity CLI, and practical strategies for model routing and tool composition.
Read more →
·2 min
Building Custom C/C++ Inference Engines: A Deep Dive into the Tradeoffs Between Performance, Control, and Engineering Cost
Deep analysis of why teams build custom C/C++ inference engines instead of using PyTorch or TensorRT, exploring performance, minimal dependencies, and long-term maintenance tradeoffs.
Read more →
·2 min
Lighthouse: A Deep Dive into HarbourMasters' Open-Source Classic Game Porting Engine
A deep dive into the Lighthouse open-source game porting engine by HarbourMasters, exploring its C-based architecture, role in the decompilation porting ecosystem, and digital game preservation.
Read more →
·2 min
antirez Strikes Again: ds4, a Pure C Local Inference Engine for DeepSeek 4
Redis creator antirez open-sources ds4, a pure C local inference engine for DeepSeek 4 Flash and PRO with native Metal, CUDA, and ROCm support, earning nearly 20K GitHub stars.
Read more →