The Transformer was proposed by Vaswani et al. in 2017 in the paper "Attention Is All You Need," and its self-attention mechanism has a computational complexity of O(n²) with respect to sequence length.