Residual Stream

A core mechanism in the Transformer decoder architecture in which the output of each decoding block is added directly to the input of the next block, forming an accumulating high-dimensional vector regarded as the model's working memory at a given position.