#distributed AI system
1618 related articles
·2 min
Distributed AI Systems: A Practical Engineering Guide to Training, Inference, and Production Deployment
A deep dive into distributed AI systems engineering: data/model/tensor parallelism for training, KV cache, quantization, elastic scaling for inference, and cloud deployment with Kubernetes, Ray, and DeepSpeed.
Read more →
·3 min
Distributed AI Systems in Practice: A Complete Guide to Training, Inference, and Production Deployment
A deep dive into Distributed AI Systems: a new book distilling 10 years of AI engineering experience covering distributed training, inference optimization, and production model serving.
Read more →
·3 min
AI Can't Build Usable Products — Developers' Jobs Haven't Disappeared
AI can generate code snippets and demos, but usable products still require human engineers' judgment and responsibility. This article analyzes AI coding tools' limits and developers' evolving roles.
Read more →
·3 min
Getting Started with MARL (Multi-Agent Reinforcement Learning): A Complete Path from Theory to Code
A systematic guide to learning MARL from theory to code, covering CleanRL, PettingZoo, PyMARL tools, IQL/VDN/QMIX/MADDPG algorithm progression, and practical tips for bridging theory and implementation.
Read more →
·2 min
Why Spell Check Correction Stopped Working After Perplexity Desktop Update — Causes and Solutions
After Perplexity's Windows desktop app migrated from standalone to MS Store version, the right-click spell correction menu disappeared. This article analyzes the root causes involving MSIX sandbox mechanisms and offers practical solutions.
Read more →
·2 min
No Soldering Required: A Guide to Reviving a Wii U with Corrupted Internal Memory
A detailed no-solder repair guide for Wii U consoles with damaged eMMC storage, using software exploits and external storage to bypass hardware replacement.
Read more →
·2 min
qm: A Deep Dive into the Multiplayer AI Agent Harness for Team Collaboration
Deep dive into qm, a multiplayer AI Agent collaboration framework that uses state sync, real-time observability, and human takeover mechanisms to transform Agents from solo tools into team infrastructure.
Read more →
·3 min
How Cheap Can It Be to Serve a 2.8 Trillion Parameter Model? A Deep Dive into Inference Economics
Deep analysis of the real cost of serving a 2.8 trillion parameter model. From MoE sparse activation to batching scale effects and inference optimization, revealing why model size and serving cost are less correlated than assumed.
Read more →
·3 min
Composer 2.5 Real-World Review: Why a Budget AI Coding Assistant Became a Daily Go-To
A developer shares their real experience with Composer 2.5, from budget pick to daily go-to. Deep comparison with Sonnet 5 in debugging scenarios reveals the gap between benchmark scores and real productivity.
Read more →
·3 min
You Don't Always Need a Vector Database for Vector Search — Brute Force Might Be All You Need
In-depth analysis of when brute force vector search beats vector databases. For RAG apps with under a few hundred thousand vectors, brute force offers exact recall, simpler architecture, and easier debugging.
Read more →
·3 min
Composer 2.5 Real-World Review: Why a Budget AI Coding Assistant Became My Daily Driver
A developer shares their real experience with Composer 2.5, from budget pick to daily driver. Deep comparison with Sonnet 5 in debugging scenarios reveals the gap between benchmark scores and real productivity.
Read more →
·4 min
Heretic Uncensoring Technology Explained: Practical Applications on Jamba2 and Qwen3.5 Open-Source Models
Deep dive into Heretic uncensoring technology applied to Jamba2-Mini, Qwen3.5-9B, and 27B open-source models, exploring how refusal rates dropped from 97% to 4% and the safety debates involved.
Read more →
·1 min
Predictive KV Replication: Breaking Through the Bursty Traffic Bottleneck in LLM Inference
Deep dive into predictive speculative KV replication: how anticipating bursty traffic and pre-replicating KV Cache can reduce LLM inference tail latency.
Read more →
·3 min
Why We Abandoned Our LLM Router: Lessons in Over-Engineering
An in-depth analysis of why teams are abandoning LLM routers, exploring hidden complexity costs, outdated cost assumptions, and how to avoid over-engineering in AI systems.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, directly challenging Intel Xeon and Nvidia. A deep dive into specs, applications, ecosystem challenges, and strategic significance.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, challenging Intel Xeon and Nvidia. Analysis of specs, applications, ecosystem challenges, and strategic significance.
Read more →
·2 min
The Accidental Architects of the Internet's Brain: How Technical Infrastructure Emerges from the Bottom Up
How the internet's core architecture was accidentally built by engineers solving specific problems—from TCP/IP to search engines to AI data infrastructure—revealing bottom-up emergence patterns.
Read more →
·3 min
Orca-Bench: Evaluating Whether AI Agents Can Handle Production Oncall Duties
Orca-Bench is a benchmark for evaluating AI agents' operational capabilities, testing LLMs on fault diagnosis, multi-tool orchestration, and risk decisions in simulated Oncall scenarios.
Read more →
·3 min
Flock License Plate Recognition System Fails: 71% of Alerts Are False Positives, Raising Doubts About AI Surveillance Reliability
Data from a California town shows Flock Safety's ALPR system has a 71% false alert rate, raising serious concerns about AI surveillance accuracy, law enforcement risks, and civil liberties.
Read more →
·3 min
Flock License Plate Recognition System Fails: 71% of Alerts Are False Positives, Raising Doubts About AI Surveillance Reliability
Data from a California town shows Flock Safety's ALPR system has a 71% false alert rate, raising serious concerns about AI surveillance accuracy, law enforcement risks, and civil liberties.
Read more →