Class Similarity

1 long-form post on Class Similarity: machine-learning research by Taha Bouhsine, each built around live, in-browser interactive visualizations.

1 post tagged #class-similarity.

Jul 4, 2026

Distillation Is a Geometry, Not an Answer Key

What crosses the wire in knowledge distillation besides the winning class? This experiment extracts a class-similarity kernel from teacher outputs and trains a student on pairwise relations alone—no labels, class names, or target probabilities. On Fashion-MNIST, the student recovers much of the label-trained geometry and approaches the spectrum of the transferred relation matrix.