A Non-linear Information Maximisation Algorithm that Performs Blind Separation

@inproceedings{Bell1994ANI,
  title={A Non-linear Information Maximisation Algorithm that Performs Blind Separation},
  author={Anthony J. Bell and Terrence J. Sejnowski},
  booktitle={NIPS},
  year={1994}
}
A new learning algorithm is derived which performs online stochastic gradient ascent in the mutual information between outputs and inputs of a network. In the absence of a priori knowledge about the 'signal' and 'noise' components of the input, propagation of information depends on calibrating network non-linearities to the detailed higher-order moments of the input density functions. By incidentally minimising mutual information between outputs, as well as maximising their individual entropies… CONTINUE READING
Highly Cited
This paper has 34 citations. REVIEW CITATIONS