Information Measure Based Skeletonisation

@inproceedings{Ramachandran1991InformationMB,
  title={Information Measure Based Skeletonisation},
  author={Sowmya Ramachandran and Lorien Y. Pratt},
  booktitle={NIPS},
  year={1991}
}
Automatic determination of proper neural network topology by trimming over-sized networks is an important area of study, which has previously been addressed using a variety of techniques. In this paper, we present Information Measure Based Skeletonisation (IMBS), a new approach to this problem where superfluous hidden units are removed based on their information measure (1M). This measure, borrowed from decision tree induction techniques, reflects the degree to which the hyperplane formed by a… CONTINUE READING