Unverified50% confidenceFactExact time
The core idea of NCM is: first use a multi-scale VQ-VAE to learn coarse-to-fine representations of text, then have a Transformer predict the discrete codes at each level in parallel, and finally reconstruct the text through a decoder.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/23/2026
First Seen
Valid until: 1/21/2027
Sources
Related Entities
Related Claims
UnverifiedNCM uses VQ-VAE to compress text into multi-level discrete codes, with coarse layers corresponding to paragraph- or semantic-topic-level abstraction and fine layers corresponding to more specific expressive details.75% similarUnverified相比早期依赖TF-IDF关键词频率的方法，当前基于Transformer架构的语义理解模型能更准确地捕捉同义表达和上下位关系71% similarVerifiedThe Transformer's encoder is responsible for mapping the input sequence to a contextual representation and is suitable for classification and understanding tasks, while the decoder autoregressively generates the output sequence and is suitable for text generation tasks69% similarUnverifiedTransformer uses Positional Encoding to retain word order information while performing parallel computation.67% similarVerifiedRerankers are typically implemented using cross-encoders, which concatenate the query and document and feed them jointly into a Transformer model, achieving significantly higher ranking precision than the initial retrieval stage67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1088743API
curl https://kongchang.com/api/v1/knowledge/claims/1088743MCP
get_claim(id=1088743)