Journal of Scientific and Industrial Research

Open Access Open Access  Restricted Access Subscription Access

Improved Chaotic Grey Wolf Optimization for Training Neural Networks


Affiliations
1 Department of Information Technology, Aditya Institute of Technology and Management, Tekkali 532 201, Andhra Pradesh, India
2 School of Computer Engineering, KIIT Deemed to be University, Bhubaneswar 751 024, Odisha, India
3 School of CSE, VIT, Amaravati 522 037, Andhra Pradesh, India
4 Department of CSE, Veer Surendra Sai University of Technology, Burla 768 018, Odisha, India
 

This paper introduces one improved version of the Grey Wolf Optimization algorithm (GWO), one of the newly established nature-inspired metaheuristic algorithms, and the suggested approach is termed Chaotic Grey Wolf Optimization (CGWO). The newly suggested approach CGWO is premeditated by the integration of the chaos technique with the GWO algorithm, aiming to resolve global optimization problems by maintaining a proper balance between exploration and exploitation. In the proposed approach, CGWO is assessed over the classic 23 benchmark functions. The proficiency of the freshly suggested approach, CGWO is verified by comparing it with contemporary methods as well as examined through statistical analysis also. Further, the same CGWO is utilized to train neural networks (MLP) by considering benchmark datasets, for data classification and establishing a better classifier algorithm.

Keywords

ANN, Chaos technique, GWO, Metaheuristic optimization, Swarm intelligence.
User
Notifications
Font Size

  • Dhiman G, SSC: A hybrid nature-inspired meta-heuristic optimization algorithm for engineering applications, Knowl-Based Syst, 222 (2021) 1–17, https://doi.org/10.1016/ j.knosys.2021.106926.

  • Uthayakumar J, Vengattaraman T & Dhavachelvan P, Swarm intelligence-based classification rule induction (CRI) framework for qualitative and quantitative approach: An application of bankruptcy prediction and credit risk analysis, J King Saud Univ Comput, 32(6) (2020) 647–57, https:// doi.org/10.1016/j.jksuci.2017.10.007.

  • Panda N, Majhi S K & Pradhan R, A hybrid approach of spotted hyena optimization integrated with quadratic approximation for training wavelet neural network, Arab J Sci Eng, 47(8) (2022) 10347–363, https://doi.org/10.1007/ s13369-022-06564-4.

  • Teng A, Peng L, Xie Y, Zhang H & Chen Z, Gradient descent evolved imbalanced data gravitation classification with an application on internet video traffic identification, Inf Sci, 539 (2020) 447–60, https://doi.org/10.1016/j.ins.2020. 05.141.

  • Karaoglan A D, Optimizing plastic extrusion process via grey wolf optimizer algorithm and regression analysis, J Sci Ind Res, 80(01) (2021) 34–41, doi:10.56042/jsir.v80i01. 35559.

  • Mahapatra A K, Panda N & Pattanayak B K, Hybrid PSO (SGPSO) with the Incorporation of discretization operator for training RBF neural network and optimal feature selection, Arab J Sci Eng, 48(8) (2023) 9991–10019, https://doi.org/10.1007/s13369-022-07408-x.

  • Mahapatra A K, Panda N & Pattanayak B K, Quantized Salp Swarm Algorithm (QSSA) for optimal feature selection, J Inf Technol, 15(2) (2023) 725–734, https://doi.org/10.1007/ s41870-023-01161-6.

  • Apat S K, Mishra J, Raju K S & Padhy N, An artificial intelligence-based crop recommendation system using machine learning, J Sci Ind Res, 82(05) (2023) 558–567, https://doi.org/10.56042/jsir.v82i05.1092.

  • Yadav V, Rahul M & Yadav R, A New Efficient Method for the detection of intrusion in 5 G and beyond Networks using Machine Learning, J Sci Ind Res, 80(01) (2021) 60–50, doi:10.56042/jsir.v80i01.38894.

  • Mirjalili S, Mirjalili S M & Lewis A, Grey wolf optimizer, Adv Eng Softw, 69 (2014) 46–61, https://doi.org/ 10.1016/j.advengsoft.2013.12.007.

  • Mirjalili S, How effective is the Grey Wolf optimizer in training multi-layer perceptrons, Appl Intell, 43 (2015) 150–161, https://doi.org/10.1007/s10489-014-0645-7.

  • Mirjalili S, Saremi S, Mirjalili S M & Coelho L D, Multi-objective grey wolf optimizer: a novel algorithm for multi-criterion optimization, Expert Syst Appl, 47 (2016) 106–119, https://doi.org/10.1016/j.eswa.2015.10.039.

  • Sharma Y & Saikia L C, Automatic generation control of a multi-area ST–Thermal power system using grey wolf optimizer algorithm based classical controllers, Int J Electr Power Energy Syst, 73 (2015) 853–862, https:// doi.org/ 10.1016/j.ijepes.2015.06.005.

  • Rodríguez L, Castillo O, Soria J, Melin P, Valdez F, Gonzalez CI, Martinez G E & Soto J, A fuzzy hierarchical operator in the grey wolf optimizer algorithm, Appl Soft Comput, 57 (2017) 315–328, https://doi.org/10.1016/ j.asoc.2017.03.048.

  • Song X, Tang L, Zhao S, Zhang X, Li L, Huang J & Cai W, Grey wolf optimizer for parameter estimation in surface waves, Soil Dyn Earthq Eng, 75 (2015) 147–57, https://doi.org/10.1016/j.soildyn.2015.04.004.

  • Kohli M & Arora S, Chaotic grey wolf optimization algorithm for constrained optimization problems, J Comput Des Eng, 5(4) (2018) 458–472, https://doi.org/10.1016/ j.jcde.2017.02.005.

  • Saxena A, Kumar R & Das S, β-chaotic map enabled grey wolf optimizer, Appl Soft Comput, 75 (2019) 84–105, https://doi.org/10.1016/j.asoc.2018.10.044.

  • Mitić M, Vuković N, Petrović M & Miljković Z, Chaotic metaheuristic algorithms for learning and reproduction of robot motion trajectories, Neural Comput Appl, 30 (2018) 1065–1083, https://doi.org/10.1007/s00521-016-2717-6.

  • Heidari A A & Abbaspour R A, Enhanced chaotic grey wolf optimizer for real-world optimization problems: A comparative study, Handbook of Research on Emergent Applications of Optimization Algorithms, IGI Global, (2018), 693–727, doi:10.4018/978-1-5225-2990-3.ch030.

  • Panda N & Majhi S K, Design and applications of improved metaheuristic algorithms for neural network training, Intelligent Technologies: Concepts, Applications, and Future Directions, (2022) 223–255, https://doi.org/10.1007/978-981-19-1021-0_10.

  • Chandra Sekhar C, Panda N, Ramana B V, Maneesha B & Vandana S, Effectiveness of backpropagation algorithm in healthcare data classification, Green Technology for Smart City and Society: Proceedings of GTSCS 2020, (2020) 289–298, https://doi.org/10.1007/978-981-15-8218-9_25.

  • Dalai A K, Jena A K, Ramana B V, Maneesha B & Panda N, Supervised machine learning approaches for medical data classification, 2022 2nd Int Conf Artif Intell Signal Process (AISP), (2022) 1–8, 10.1109/AISP53593.2022.9760688.

  • Jagadeeswara Rao G, Siva Prasad A, Sai Srinivas S, Sivaparvathi K & Panda N, Data classification by ensemble methods in machine learning, Adv in Intell Comput Commun: Proc ICAC 2021, (2022) 127–135, https://doi.org/10.1007/ 978-981-19-0825-5_13.

  • Mohakud R & Dash R, Designing a grey wolf optimization based hyper-parameter optimized convolutional neural network classifier for skin cancer detection, J King Saud Univ Comput, 34(8) (2022) 6280–6291, https://doi.org/ 10.1016/j.jksuci.2021.05.012.

  • Mischaikow K & Mrozek M, Chaos in the Lorenz equations: a computer-assisted proof, Bull Am Math Soc, 32(1) (1995) 66–72, https://doi.org/10.1090/S0273-0979-1995-00558-6.

  • Firth W J, Chaos--predicting the unpredictable, BMJ-BRIT MED J, 303 (1991) 1565–1568, doi:10.1136/bmj. 303.6817.1565.

  • Ditto W & Munakata T, Principles and applications of chaotic systems, Commun ACM, 38(11) (1995) 96–102, https://doi.org/10.1145/219717.219797.

  • Selvam A M, Nonlinear dynamics and chaos: Applications in atmospheric sciences, J Adv Math Appl, 1(2) (2012) 181–205, https://doi.org/10.1166/jama.2012.1014.

  • Safonov L A, Tomer E, Strygin V V, Ashkenazy Y & Havlin S, Multifractal chaotic attractors in a system of delay-differential equations modeling road traffic, Chao, 12(4) (2002) 1006–1014, https://doi.org/10.1063/1.1507903.

  • Mirjalili S, Gandomi A H, Mirjalili S Z, Saremi S, Faris H & Mirjalili S M, Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems, Adv Eng Softw, 114 (2017) 163–91, https://doi.org/10.1016/j.advengsoft. 2017.07.002.

  • Mirjalili S, Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm, Knowl-based Syst, 89 (2015) 228–249, https://doi.org/10.1016/j.knosys. 2015.07.006.

  • Mirjalili S, SCA: a sine cosine algorithm for solving optimization problems, Knowl-based Syst, 96 (2016) 120–33, https://doi.org/10.1016/j.knosys.2015.12.022.

  • Mirjalili S, The ant lion optimizer, Adv Eng Soft, 83 (2015) 80–98, https://doi.org/10.1016/j.advengsoft.2015.01.010.

  • F Distribution Table, March 2018. Retrieved from http://www.socr.ucla.edu/applets.dir/f_table.html.

  • Normal Distribution Table. Retrieved from http:// math.arizona.edu/~rsims/ma464/standardnormaltable.pdf.

  • Bache K & Lichman M, UCI Machine Learning Repository [http://archive. ics. uci. edu/ml]. Irvine, CA: University of California, School of information and computer science, 28 (2013).


Abstract Views: 97

PDF Views: 53




  • Improved Chaotic Grey Wolf Optimization for Training Neural Networks

Abstract Views: 97  |  PDF Views: 53

Authors

B. V. Ramana
Department of Information Technology, Aditya Institute of Technology and Management, Tekkali 532 201, Andhra Pradesh, India
Nibedan Panda
School of Computer Engineering, KIIT Deemed to be University, Bhubaneswar 751 024, Odisha, India
S. Teja
Department of Information Technology, Aditya Institute of Technology and Management, Tekkali 532 201, Andhra Pradesh, India
Hitesh Mohapatra
School of Computer Engineering, KIIT Deemed to be University, Bhubaneswar 751 024, Odisha, India
A. K. Dalai
School of CSE, VIT, Amaravati 522 037, Andhra Pradesh, India
S. K. Majhi
Department of CSE, Veer Surendra Sai University of Technology, Burla 768 018, Odisha, India

Abstract


This paper introduces one improved version of the Grey Wolf Optimization algorithm (GWO), one of the newly established nature-inspired metaheuristic algorithms, and the suggested approach is termed Chaotic Grey Wolf Optimization (CGWO). The newly suggested approach CGWO is premeditated by the integration of the chaos technique with the GWO algorithm, aiming to resolve global optimization problems by maintaining a proper balance between exploration and exploitation. In the proposed approach, CGWO is assessed over the classic 23 benchmark functions. The proficiency of the freshly suggested approach, CGWO is verified by comparing it with contemporary methods as well as examined through statistical analysis also. Further, the same CGWO is utilized to train neural networks (MLP) by considering benchmark datasets, for data classification and establishing a better classifier algorithm.

Keywords


ANN, Chaos technique, GWO, Metaheuristic optimization, Swarm intelligence.

References