Concept
learning_rate
A hyperparameter in machine learning that controls the step size by which model parameters are updated during gradient descent.
Timeline (last 90 days)
Oct 13
With a fixed learning_rate, when batch_size scales linearly with the number of environments and num_epoch remains unchanged, the total displacement pushing the policy toward a new distribution in a single iteration may increase, manifesting as violent oscillation or even collapse of rewards in the early stages of training.
Unverified50%