ConceptNCM / 下一概念建模
Next-Concept Modeling
A language modeling paradigm that replaces token-by-token prediction with hierarchical encoding of discrete concepts. Generation proceeds in parallel from coarse to fine, and a decoder reconstructs the text.
A language modeling paradigm that replaces token-by-token prediction with hierarchical encoding of discrete concepts. Generation proceeds in parallel from coarse to fine, and a decoder reconstructs the text.