[KongchangAI]
Concept序列结束token / End of Sequence token

EOS token

A token serving as the sequence terminator in autoregressive and diffusion language models; once it is committed, the decoding process ends and no further tokens are generated.

Timeline (last 90 days)

Nov 17

An early end-of-sequence (EOS) token directly truncates the answer and is the worst error case in parallel decoding.

Unverified50%
Oct 12

During the aggregation stage, spatial relation information is lost in the global representation regardless of whether it is aggregated via the EOS token or mean pooling

Unverified50%
Oct 12

EOS token aggregation and mean pooling are currently the two most mainstream methods for generating a global sentence vector from sequence representations

Unverified50%
Oct 12

The EOS token aggregates global contextual information through the self-attention mechanism and is widely used in contrastive learning (e.g., CLIP) and retrieval tasks

Unverified50%

All Facts (4)

Source Articles