#kernel launch overhead
108 related articles
CUDA Kernel Fusion: A Practical Guide …
·2 min
CUDA Kernel Fusion: A Practical Guide to Reducing Memory Bandwidth and Launch Overhead
Learn how CUDA Kernel Fusion merges multiple GPU kernels to reduce global memory traffic and launch overhead, with real-world examples from AI inference and deep learning.
Read more →
·3 min
Goodbye ZimaOS: A Guide to Choosing Your Next Home NAS System
Migrating from ZimaOS? This guide compares Debian+Docker, TrueNAS SCALE, and Proxmox VE, analyzing pros and cons for home server users seeking their next step.
Read more →
·3 min
Goodbye ZimaOS: A Guide to Choosing Your Next Home NAS System
Migrating from ZimaOS? This guide compares Debian+Docker, TrueNAS SCALE, and Proxmox VE, analyzing pros and cons for home server users seeking their next step.
Read more →
·3 min
Git Worktree Is Not an Isolation Boundary for AI Coding Agents: Real Sandboxing Solutions Explained
Analysis of why Git worktree fails as a security boundary for AI coding agents like Claude Code and Cursor, and why containers and VMs are the real solution.
Read more →
·2 min
FindDiskKiller: Catch the Mac Apps Secretly Thrashing Your Disk
FindDiskKiller is a free open-source macOS disk activity monitor that tracks per-process I/O, monitors AI coding assistants' disk usage, and includes SMART/NVMe health checks to protect your Mac SSD.
Read more →
·2 min
DockAMP: Easily Manage Your Docker Web Development Stack with a Web Interface
DockAMP is a Docker-based web stack visual management tool that lets you manage Apache, Nginx, PHP, MySQL containers through a browser interface, offering an XAMPP-like experience for Docker-based web development.
Read more →
·3 min
Running Android Apps in Docker Containers: A Comparison of Three Approaches with Practical Guide
Explore running Android apps in Docker containers, comparing containerized emulators (redroid/docker-android), API packet capture, and notification forwarding tools with GMS push limitations analysis.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
Deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on RTX 5080. Exploring its architecture, Metal porting plans, and applications in VTuber, AR/VR, and sports analysis.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
A deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on an RTX 5080.
Read more →
·2 min
Rootless Containers: A Practical Guide to More Secure Service Deployment
A deep dive into Rootless Containers: technical principles, security advantages, and production practices. Learn how user namespaces and daemonless architecture reduce container escape risks.
Read more →
·2 min
Rootless Containers: A Practical Guide to More Secure Service Deployment
A deep dive into rootless containers: technical principles, security advantages, and production practices. Learn how user namespaces and daemonless architecture reduce container escape risks.
Read more →
·3 min
Sub-Second Code Search: Building an Indexing Plugin with Cursor + Codex
How to achieve millisecond-level code search in massive repositories with hundreds of thousands of files? A hands-on look at building a code search plugin with Cursor + Codex, powered by Lucene inverted indexing and BM25 ranking.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics on Model Quantization and Inference Deployment
A systematic guide to must-know AI application engineer interview topics: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics in Model Quantization and Inference Deployment
A systematic review of must-know topics for AI Application Engineer interviews: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·7 min
Getting Started with Codex: Installation and Usage Guide for OpenAI's AI Coding Agent
A comprehensive guide to OpenAI's new AI coding agent Codex: from concept and comparison of its four forms, to installing Git/Node.js/VS Code, configuring the API Key, and creating a workspace.
Read more →
·7 min
The Complete Guide to LLM Application Engineer Interviews: Six High-Frequency Agent Topics
A focused guide to core LLM application engineer interview topics, covering agent architecture, Multi-Agent, Langfuse evaluation, security, and RAG optimization.
Read more →
·7 min
Alibaba Open-Sources 2.4T Qwen Model as Chinese AI Sweeps the Global Competitive Landscape
Alibaba open-sources a 2.4 trillion parameter Qwen model and launches the Qwen Token Plan. Chinese models surge, Kimi K3 tops global rankings, and China's AI is reshaping the global competitive landscape.
Read more →
Handwritten C/CUDA Inference Engine: P…
·2 min
Handwritten C/CUDA Inference Engine: Pushing Qwen 35B to the Limits on RTX 5090
A deep dive into a handwritten C/CUDA inference engine for Qwen 35B on RTX 5090 (Blackwell), covering quantization, FlashAttention kernels, and memory optimization.
Read more →
Why We Must Actively Fund Open Source …
·2 min
Why We Must Actively Fund Open Source AI: A Public Goods Perspective on Technology Democratization
Open source AI faces soaring compute costs and fierce talent competition that markets alone can't solve. This deep dive explores why actively funding open source AI is essential for tech democratization.
Read more →
Java Local LLM Inference: Low-Latency …
·2 min
Java Local LLM Inference: Low-Latency LLM Deployment with Panama FFM
Learn how Java and OpenJDK Panama FFM API enable local LLM inference. Explore the technical foundations, JVM ecosystem benefits, and low-latency AI deployment in enterprise Java systems.
Read more →