In the first attempt, after about 20 minutes of training the policy learned to walk, but peak foot force was about 4.6 times body weight and step frequency was about 230 steps per minute; with mean actions (no noise) it fell every time.