The interleaved RoPE format pairs adjacent two dimensions for rotation, while the non-interleaved format pairs the first half and the second half for rotation; the two formats are mathematically equivalent but their implementations are not interchangeable.