CLIP

CLIP and the modality gap: why image and text embeddings sit in separate cones, and when the gap is a choice rather than a bug.

1 post tagged #clip.

May 26, 2026

Untangling the Moons: A Visual History of Contrastive Learning

Eight contrastive losses, twenty years of history, and one geometric audit. Watch the losses organize the same 2D points while separating opposition, orthogonality, simplex packing, and statistical independence.