The theoretical foundation of supervised learning can be traced back to the perceptron model proposed by Frank Rosenblatt in the 1950s.