Information-theoretic criteria for the design of compressive subspace classifiers

Abstract

Using Shannon theory, we derive fundamental, asymptotic limits on the classification of low-dimensional subspaces from compressive measurements. We identify a syntactic equivalence between the classification of subspaces and the communication of codewords over non-coherent, multiple-antenna channels, from which we derive sharp bounds on the number of classes that can be discriminated with low misclassification probability as a function of the signal dimensionality and the signal-to-noise ratio. While the bounds are asymptotic in the limit of high dimension, they provide intuition for classifier design at finite dimension. We validate this intuition via an application to face recognition.

DOI: 10.1109/ICASSP.2014.6854164

Extracted Key Phrases

3 Figures and Tables

Cite this paper

@article{Nokleby2014InformationtheoreticCF, title={Information-theoretic criteria for the design of compressive subspace classifiers}, author={Matthew S. Nokleby and Miguel R. D. Rodrigues and A. Robert Calderbank}, journal={2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, year={2014}, pages={3067-3071} }