The Improved Training Algorithm of Back Propagation Neural Network with Self-adaptive Learning Rate

  title={The Improved Training Algorithm of Back Propagation Neural Network with Self-adaptive Learning Rate},
  author={Y. Li and Y. Fu and H. Li and S. Zhang},
  journal={2009 International Conference on Computational Intelligence and Natural Computing},
  • Y. Li, Y. Fu, +1 author S. Zhang
  • Published 2009
  • Computer Science
  • 2009 International Conference on Computational Intelligence and Natural Computing
This paper addresses the questions of improving convergence performance for back propagation (BP) neural network. For traditional BP neural network algorithm, the learning rate selection is depended on experience and trial. In this paper, based on Taylor formula the function relationship between the total quadratic training error change and connection weights and biases changes is obtained, and combined with weights and biases changes in batch BP learning algorithm, the formula for self… Expand
54 Citations
Training neural network with damped oscillation and maximized gradient function
  • 2
Fuzzy Wavelet Neural Network With an Accelerated Hybrid Learning Algorithm
  • 94
Beyond back-propagation learning for diabetic detection: Convergence comparison of gradient descent, momentum and Adaptive Learning Rate
  • 5
An Adaptive Neural Network for Email Spam Classification
Optimizing Deep Feedforward Neural Network Architecture: A Tabu Search Based Approach
  • 5
  • PDF


The improvements of BP neural network learning algorithm
  • W. Jin, Z. Li, L. Wei, Han Zhen
  • Computer Science
  • WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000
  • 2000
  • 157
Convergence of Batch BP Algorithm with Penalty for FNN Training
  • 29
  • PDF
A Hybrid Training Algorithm for Feedforward Neural Networks
  • 28
A Novel BP Algorithm Based on Self-adaptive Parameters and Performance Analysis
  • Haibin Cai, Liangxu Liu, Qiying Cao
  • Mathematics, Computer Science
  • First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06)
  • 2006
  • 4
Parameter effects on convergence speed and generalization capability of backpropagation algorithm
  • 17
Learning internal representations by error propagation
  • 18,432
  • PDF
Cryptand/metalion coated piezoelectric quartz crystal sensors with artificial back propagation neural network analysis for nitrogen dioxide and carbon monoxide
  • Sensors and Actuators B: Chemical, vol. 106, Apr. 2005, pp.468–476, doi: 10.1016/j.snb.2004.09.009.
  • 2005
Convergence of batch bp
  • Convergence of batch bp