#contrastive-learning
3 posts tagged #contrastive-learning.
-
Organizing Randomness: Contrastive Learning in JAX
A block-by-block JAX + Optax implementation of six contrastive losses, each watched as a real animated GIF turning random 2D points into organized embeddings. The runnable companion to "Untangling the Moons."
-
Untangling the Moons: A Visual History of Contrastive Learning
Eight contrastive losses, twenty years of history, one interactive playground. Watch pair, triplet, InfoNCE, CLIP, SupCon, SigLIP, alignment+uniformity, and cosine→0 organize 2D points — and see which ones know when to stop.
-
Not All Infinities Are Equal: The Cross-Entropy Asymmetry Behind Hallucination
The singularity structure of cross-entropy is asymmetric — and that asymmetry explains LLM hallucination, the CLIP modality gap, and why contrastive losses need 32K batches.