#DQN

Training a Small DQN on CPU: How to Properly Scale the Learner Side

DQN on CPU stuck at 400 steps/sec? This article breaks down multi-process Worker parallelism, Actor-Learner decoupling, Replay Buffer design, replay ratio tuning, and whether small networks benefit from GPU.