# The Improved Training Algorithm of Back Propagation Neural Network with Self-adaptive Learning Rate

@article{Li2009TheIT, title={The Improved Training Algorithm of Back Propagation Neural Network with Self-adaptive Learning Rate}, author={Y. Li and Y. Fu and H. Li and S. Zhang}, journal={2009 International Conference on Computational Intelligence and Natural Computing}, year={2009}, volume={1}, pages={73-76} }

This paper addresses the questions of improving convergence performance for back propagation (BP) neural network. For traditional BP neural network algorithm, the learning rate selection is depended on experience and trial. In this paper, based on Taylor formula the function relationship between the total quadratic training error change and connection weights and biases changes is obtained, and combined with weights and biases changes in batch BP learning algorithm, the formula for self… Expand

#### 54 Citations

Weights adjustment of two-term back-propagation network using adaptive and fixed learning methods

- Computer Science
- SOCO 2013
- 2013

2

Improving Error Back Propagation Algorithm by using Cross Entropy Error Function and Adaptive Learning Rate

- Computer Science
- 2017

4

A novel strategy for speed up training for back propagation algorithm via dynamic adaptive the weight training in artificial neural network

- Computer Science
- 2015

2- PDF

Training neural network with damped oscillation and maximized gradient function

- Computer Science
- 14th International Conference on Computer and Information Technology (ICCIT 2011)
- 2011

2

Dynamically-adaptive Weight in Batch Back Propagation Algorithm via Dynamic Training Rate for Speedup and Accuracy Training

- Computer Science
- 2018

2- PDF

Fuzzy Wavelet Neural Network With an Accelerated Hybrid Learning Algorithm

- Mathematics, Computer Science
- IEEE Transactions on Fuzzy Systems
- 2012

94

Beyond back-propagation learning for diabetic detection: Convergence comparison of gradient descent, momentum and Adaptive Learning Rate

- Computer Science
- 2017 1st International Conference on Informatics and Computational Sciences (ICICoS)
- 2017

5

An Adaptive Neural Network for Email Spam Classification

- Computer Science
- 2019 Fifteenth International Conference on Information Processing (ICINPRO)
- 2019

A Joint Optimization of Momentum Item and Levenberg-Marquardt Algorithm to Level Up the BPNN’s Generalization Ability

- Mathematics
- 2014

1- PDF

Optimizing Deep Feedforward Neural Network Architecture: A Tabu Search Based Approach

- Computer Science, Mathematics
- Neural Processing Letters
- 2020

5- PDF

#### References

SHOWING 1-9 OF 9 REFERENCES

The improvements of BP neural network learning algorithm

- Computer Science
- WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000
- 2000

157

Convergence of Batch BP Algorithm with Penalty for FNN Training

- Mathematics, Computer Science
- ICONIP
- 2006

29- PDF

A Hybrid Training Algorithm for Feedforward Neural Networks

- Computer Science
- Neural Processing Letters
- 2006

28

A Novel BP Algorithm Based on Self-adaptive Parameters and Performance Analysis

- Mathematics, Computer Science
- First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06)
- 2006

4

Parameter effects on convergence speed and generalization capability of backpropagation algorithm

- Computer Science
- 1993

17

Cryptand/metalion coated piezoelectric quartz crystal sensors with artificial back propagation neural network analysis for nitrogen dioxide and carbon monoxide

- Sensors and Actuators B: Chemical, vol. 106, Apr. 2005, pp.468–476, doi: 10.1016/j.snb.2004.09.009.
- 2005

Convergence of batch bp

- Convergence of batch bp