Concepttoken merging
Token Merging
A training-free inference-time visual token compression method that aggregates several similar tokens into a single representative vector. It reduces sequence length while preserving information; a common approach performs bipartite matching on adjacent patches and then averages them.
Timeline (last 90 days)
Oct 14
Token pruning refers to directly discarding some visual tokens based on importance scores, with a high compression rate but irreversibility; token merging instead aggregates similar tokens into representative vectors, preserving information while reducing sequence length.
Unverified50%