Statistically controlled activation weight initialization (SCAWI)

  title={Statistically controlled activation weight initialization (SCAWI)},
  author={Gian Paolo Drago and Sandro Ridella},
  journal={IEEE transactions on neural networks},
  volume={3 4},
An optimum weight initialization which strongly improves the performance of the back propagation (BP) algorithm is suggested. By statistical analysis, the scale factor, R (which is proportional to the maximum magnitude of the weights), is obtained as a function of the paralyzed neuron percentage (PNP). Also, by computer simulation, the performances on the convergence speed have been related to PNP. An optimum range for R is shown to exist in order to minimize the time needed to reach the… CONTINUE READING
Highly Cited
This paper has 163 citations. REVIEW CITATIONS
54 Citations
0 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 54 extracted citations

163 Citations

Citations per Year
Semantic Scholar estimates that this publication has 163 citations based on the available data.

See our FAQ for additional information.

Similar Papers

Loading similar papers…