NCM

A text generation paradigm based on hierarchical latent representations: text is first encoded into multi-granularity discrete codes using a multi-scale VQ-VAE, a Transformer then predicts the codes at each level in parallel, and the text is finally decoded and reconstructed, aiming to replace next-token prediction with parallel generation.