Transformer-XL

An extended architecture based on the Transformer that models long-range dependencies by introducing a recurrence mechanism and relative position encoding, improving long-sequence processing capability.