NEAT starts from extremely simple networks (often with only a direct connection between the input and output layers) and gradually grows more complex structures through two mutation operations: adding nodes and adding connections.