Improving the error backpropagation algorithm with a modified error function

@article{Oh1997ImprovingTE,
  title={Improving the error backpropagation algorithm with a modified error function},
  author={Sang-Hoon Oh},
  journal={IEEE transactions on neural networks},
  year={1997},
  volume={8 3},
  pages={799-803}
}
This letter proposes a modified error function to improve the error backpropagation (EBP) algorithm of multilayer perceptrons (MLPs) which suffers from slow learning speed. To accelerate the learning speed of the EBP algorithm, the proposed method reduces the probability that output nodes are near the wrong extreme value of sigmoid activation function. This is acquired through a strong error signal for the incorrectly saturated output node and a weak error signal for the correctly saturated… CONTINUE READING