Phase transitions in Vector Quantization

We study Winner-Takes-All and rank based Vector Quantization along the lines of the statistical physics of off-line learning. Typical behavior of the system is obtained within a model where high-dimensional training data are drawn from a mixture of Gaussians. The analysis becomes exact in the simplifying limit of high training temperature. Our main findings… CONTINUE READING