[KongchangAI]
ModelMoCo / Momentum Contrast

MoCo

Momentum Contrast,一种基于动量对比的自监督视觉学习方法,通过动量更新的编码器实现稳定的对比学习

Timeline (last 90 days)

Oct 7

Mainstream contrastive learning frameworks such as SimCLR, MoCo, and CLIP typically use cosine similarity as the metric, implicitly fixing the representation space to a uniform Euclidean geometry on a hypersphere.

Unverified50%
Sep 5

Contrastive learning methods (such as SimCLR, BYOL, and MoCo) rely on data augmentation to construct positive and negative sample pairs, whereas JEPA does not depend on explicit data augmentation strategies.

Unverified50%

All Facts (2)

Source Articles