Neural Turing Machine
An architecture that combines a neural network with an external memory matrix, reading from and writing to memory through attention mechanisms in order to let the network learn algorithmic behavior. It is an early representative work in differentiable programming.
Timeline (last 90 days)
"Weights as program" is not an entirely new concept; early work such as Neural Turing Machines and Differentiable Neural Computers attempted to let networks learn algorithm behavior.
Typical implementations of deep recursive reasoning models include variants such as the Recurrent Transformer, the Universal Transformer, and the Neural Turing Machine.
Spotlight's memory approach is architecturally close in philosophy to early explorations of Neural Turing Machines (NTM) and Memory-Augmented Neural Networks (MANN).
All Facts (3)
"Weights as program" is not an entirely new concept; early work such as Neural Turing Machines and Differentiable Neural Computers attempted to let networks learn algorithm behavior.
50%UnverifiedTypical implementations of deep recursive reasoning models include variants such as the Recurrent Transformer, the Universal Transformer, and the Neural Turing Machine.
50%UnverifiedSpotlight's memory approach is architecturally close in philosophy to early explorations of Neural Turing Machines (NTM) and Memory-Augmented Neural Networks (MANN).
50%