The introduction of flexible structures adds higher degrees of freedom and nonlinearity, which may increase the difficulty of convergence in reinforcement learning training.