Towards Optimally Distributed Computation

Abstract

This article introduces the concept of optimally distributed computation in feedforward neural networks via regularization of weight saliency. By constraining the relative importance of the parameters, computation can be distributed thinly and evenly throughout the network. We propose that this will have beneficial effects on fault-tolerance performance and… (More)
DOI: 10.1162/089976698300017593

8 Figures and Tables

Topics

  • Presentations referencing similar topics