![Open Access](https://i-scholar.in/lib/pkp/templates/images/icons/fulltextgreen.png)
![Restricted Access](https://i-scholar.in/lib/pkp/templates/images/icons/fulltextred.png)
![Open Access](https://i-scholar.in/lib/pkp/templates/images/icons/fulltextgreen.png)
![Open Access](https://i-scholar.in/lib/pkp/templates/images/icons/fulltext_open_medium.gif)
![Restricted Access](https://i-scholar.in/lib/pkp/templates/images/icons/fulltextred.png)
![Restricted Access](https://i-scholar.in/lib/pkp/templates/images/icons/fulltext_restricted_medium.gif)
Comparative Study of Adaptive Learning Rate with Momentum and Resilient Back Propagation Algorithms for Neural Net Classifier Optimization
Subscribe/Renew Journal
Learning algorithms are generally used to optimize the convergence of neural networks. We need to optimize the convergence of neural networks in order to increase the speed and accuracy of decision making process. One such algorithm that is used to facilitate the optimization process is back propagation learning algorithm. The objective of this study is to compare the performance of two variations of back propagation learning algorithm (Adaptive learning rate with momentum and Resilient). Both the algorithms are experimented on a variety of classification problems in order to assess the efficiency of these two learning approaches. Experimental results reveal that during testing and training Resilient propagation algorithm outperforms back propagation with Adaptive learning rate and momentum.
Keywords
ANN, Back-Propagation, RPROP, Learning Rate, Momentum.
Subscription
Login to verify subscription
User
Font Size
Information
- Fisher, R. A. (1936). The use of multiple measurements in taxonomic problems. Annual Eugenics, 7(2), 179-188.
- Howard, D. & Mark, B. (2002). Neural Network Toolbox for use with Matlab. User's Guide Version 4.
- Wahed, M. A. (2008). Adaptive learning rate versus Resilient back propagation for numeral recognition. Journal of Al-Anbar University for Pure Science, 2(1), 94-105.
- Rumelhart, D. E., Hinton, G. E. & Williams, R. J. (1986). Learning Internal Representations by Error Propagation. Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Cambridge: MIT Press.
- Braun, R. H. (1993). A Direct Adaptive Method for Faster Back-Propagation Learning: The RPROP Algorithm. Paper presented at the Proceedings of the International Conference on Neural Networks (pp. 586-591).
- Riedmiller, M. (1994). RPROP Description and Implementation Details Technical Report. University of Karlsruhe W-76128 Karlsruhe.
- Saduf, M. A. W. (2013). Comparative study of back-propagation algorithms for neural networks. International Journal of Advanced Research in Computer Science & Software Engineering, 3(12), 1151-1156.
- Wolberg, W. H. & Mangasarian, O. L. (1990). Multisurface Method of Pattern Separation for Medical Diagnosis Applied to Breast Cytology. Paper presented at National Academy of Sciences, 87, 919-996.
- Zhang, G. P. (2000). Neural Networks for Classification: A Survey. IEEE Transactions on Systems Man and Cybernetics. Part C: Applications and Reviews, 30(4), 451-462.
![](https://i-scholar.in/public/site/images/abstractview.png)
Abstract Views: 404
![](https://i-scholar.in/public/site/images/pdfview.png)
PDF Views: 3