2 related articles

Experiments show DINOv2 Giant scores just 41% on k-NN classification, while SigLIP2 reaches 92%. This article dives into the embedding-space differences between contrastive and self-supervised learning to guide vision encoder selection.

Block-sparse featurizers remap dense vision model activations into block-sparse representations, making the internal feature spaces of ViT, CNN, and other models readable and interpretable. This article explores their core principles, links to mechanistic interpretability, and applications.