Journal of Scientific and Industrial Research

Open Access Open Access  Restricted Access Subscription Access

Haar Adaptive Taylor-ASSCA-DCNN: A Novel Fusion Model for Image Quality Enhancement


Affiliations
1 Department of Computer Science and Engineering, Harcourt Butler Technical University, East Campus, Nawabganj, Kanpur, Uttar Pradesh 208 002, India., India
 

In medical imaging, image fusion has a prominent exposure in extracting complementary information out of varying medical image modalities. The utilization of different medical image modality had imperatively improved treatment information. Each kind of modality contains specific data regarding subject being imaged. Various techniques are devised for solving the issue of fusion, but the major issue of these techniques is key features loss in fused image, which also leads to unwanted artefacts. This paper devises an Adaptive optimization driven deep model fusing for medical images to obtain the essential information for diagnosis and research purpose. Through our proposed fusion scheme based on Haar wavelet and Adaptive Taylor ASSCA Deep CNN wehave developed fusion rules to amalgamate pairs of Magnetic Resonance Imaging i.e. MRI like T1, T2. Through experimental analysis our proposed method shown for preserving edge as well as component related information moreover tumour detection efficiency has also been increased. Here, as input, two MRI images have been considered. Then Haarwavelet is adapted on both MRI imagesfor transformation of images in low as well as high frequency sub-groups. Then, the fusion is done withcorrelation-based weighted model. After fusion, produced output is imposed to final fusion, which is executed through Deep Convolution Neural Network (DCNN). The Deep CNN is trained here utilizing Adaptive Taylor Atom Search Sine Cosine Algorithm (Adaptive Taylor ASSCA). Here, the Adaptive Taylor ASSCA is obtained by integrating adaptive concept in Taylor ASSCA. The highest MI of 1.672532 have been attained using db2 wavelet for image pair 1, highest PSNR 42.20993dB using db 2 wavelet for image pair 5 and lowest RMSE 5.204896 using sym 2 wavelet for image pair 5, havebeen shown proposed Adaptive Taylor ASO + SCA-based Deep CNN.

Keywords

Correlation-Based Weighted Model, Deepmodel, Haar Wavelet, Magnetic Resonance Imaging (MRI), Medical Image Fusion.
User
Notifications
Font Size

  • Kaur M & Singh D, Multi–modality medical image fusion technique using multi-objective differential evolution based deep neural networks, J Ambient Intell Hum Comput, 12(2) (2021) 2483–2493.

  • Dinh P H, Multi-modal medical image fusion based on equilibrium optimizer algorithm and local energy functions, Appl Intell, 51(21)(2021) 1–16.

  • Li Y, Zhao J, Lv Z & Li J, Medical image fusion method by deep learning, Int J Cognit Comput Eng, 2(2021) 21–29.

  • Huang X, Zhang B, Zhang X, Tang M, Miao Q, Li T & Jia G, Application of U-Net based multiparameter magnetic resonance image fusion in the diagnosis of prostate cancer, IEEE Access,9(2021) 33756–33768.

  • Khan U, Paheding S, Elkin C & Devabhaktuni V, Trends in deep learning for medical hyperspectral image analysis, IEEE Access, 9(2021) 79534–79548.

  • Kong W, Li C & Lei Y, Multimodal medical image fusion using convolutional neural network and extreme learning machine, Front Neurorob, (2022).

  • Kumar V, Gupta A, Hazarika B B & Gupta D, Automatic diagnosis of COVID-19 from Chest X-ray images using transfer learning-based deep features and machine learning models (2022).

  • Zhou T, Li Q, Lu H, Cheng Q & Zhang X, GAN review: Models and medical image fusion applications, Information Fusion, 91(2023) 134–148.

  • Singh V & Kaushik V D, HoEnTOA: Holoentropy and Taylor assisted optimization based a novel image quality enhancement algorithm for multi-focus image fusion, J Sci Ind Res, 80(10)(2021) 875–886, Doi: 10.56042/ jsir.v80i10.52244

  • [10] Guo P, Xie G, Li R & Hu H, Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain, Complex & Intelligent Systems, 9(1)(2023) 317–328.

  • Srikanth M V, Prasad V V K D V & Prasad K S, Brain tumor detection through modified optimization algorithm by region-based image fusion, ECTI Trans Comput Inf Technol, 17(1)(2023) 117–127.

  • Singh V & Kaushik V D, A study of multi-focus image fusion: State-of-the-art techniques, in Advances in Data and Information Sciences: Proceedings of ICDIS 2021(Springer Singapore) 2022, 563–572, Doi: 10.1007/978-981-16-5689-7_49.

  • Singh V & Kaushik V D, A Typical Hybrid Optimization-Based Image Quality Enhancement Technique, in Proceedings of International Conference on Computational Intelligence, Data Science and Cloud Computing: IEM-ICDC 2021(Springer Nature Singapore) 2022, 225-233, Doi: 10.1007/978-981-19-1657-1_18.

  • [14] Singh V & Kaushik V D, A Brief Study and Overview of Image Fusion Methods, In Proceedings of International Conference on Computational Intelligence, Data Science and Cloud Computing: IEM-ICDC 2020, Springer Singapore, (2021) 355–367, Doi: 10.1007/978-981-33-4968-1_28.

  • Azam M A, Khan K B, Salahuddin S, Rehman E, Khan S A, Khan M A & Gandomi A H (2022). A review on multimodal medical image fusion: Compendious analysis of medical modalities, multimodal databases, fusion techniques and quality metrics, Comput Biol Med, 144(2022) 105253.

  • Pei C, Fan K & Wang W, Two-scale multimodal medical image fusion based on guided filtering and sparse representation, IEEE Access, 8(2020) 140216–140233.

  • Nejati M, Samavi S, Karimi N, Soroushmehr S R, Shirani S, Roosta I & Najarian, Surface area-based focus criterion for multi-focus image fusion, Inf Fusion, 36(2017) 284–295.

  • Jin X, Chen G, Hou J, Jiang Q, Zhou D & Yao S, Multimodal sensor medical image fusion based on nonsubsampled shearlet transform and S-PCNNs in HSV space, Signal Process, 153 (2018) 379–395.

  • Yang Y, Tong S, Huang S & Lin P, Log-Gabor energy based multimodal medical image fusion in NSCT domain, Comput Math Methods Med (2014).

  • Irshad M T & Rehman H U, Gradient compass-based adaptive multimodal medical image fusion, IEEE Access, 9(2021) 22662–22670.

  • Jose J, Gautam N, Tiwari M, Tiwari T, Suresh A, Sundararaj V & Rejeesh M R, An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multimodal medical image fusion, Biomed Signal Process Control, 66(2021) 102480.

  • Shehanaz S, Daniel E, Guntur S R & Satrasupalli S, Optimum weighted multimodal medical image fusion using particle swarm optimization, Optik, 231(2021) 166413.

  • Li X, Zhou F, Tan H, Zhang W & Zhao C, Multimodal medical image fusion based on joint bilateral filter and local gradient energy, Inf Sci, 569(2021) 302–325.

  • He C, Liu Q, Li H & Wang H, Multimodal medical image fusion based on IHS and PCA, Procedia Eng, 7(2010) 280– 285.

  • Bhatnagar G, Wu Q J & Liu Z, Directive contrast based multimodal medical image fusion in NSCT domain, IEEE Trans Multimedia, 15(5)(2013) 1014–1024.

  • Huang B, Yang F, Yin M, MoX & Zhong C, A review of multimodal medical image fusion techniques, Comput Math Methods Med(2020).

  • Tedmori S & Al-Najdawi N, Image cryptographic algorithm based on the Haar wavelet transform, Inform Sci, 269(2014) 21–34.

  • Tu F, Yin S, Ouyang P, Tang S, Liu L & Wei S, Deep convolutional neural network architecture with reconfigurable computation patterns, IEEE Trans Very Large Scale Integr VLSI Syst, 25(8)(2017) 2220–2233.

  • Multimodal Brain Tumor Segmentation Challenge 2018 (BraTS), [https://wiki.cancerimagingarchive.net/pages/viewpage.actio n?pageId=37224922" accessed on July 2021].

  • Venkatrao P H & Damodar SS, HWFusion: Holoentropy and SP-Whale optimisation-based fusion model for magnetic resonance imaging multimodal image fusion, IET Image Process, 12(4)(2018) 572–581.

  • Kavitha S & Thyagharajan K K, Efficient DWT– based fusion techniques using genetic algorithm for optimal parameter estimation, Soft Comput, 21(12)(2017) 3307– 3316.

  • Singh V & Kaushik V D, Renyi entropy and atom search sine cosine algorithm for multi focus image fusion, Signal Image Video Process, 15(2021) 903–912, Doi: https://doi.org/10.1007/s11760-020-01814-0.

  • Singh V and Kaushik V D,WeAbDeepCNN: Weighted average model and ASSCA based two level fusion scheme for multi-focus Images, J Sci Ind Res, 80(10)(2021) 905– 914, Doi: 10.56042/jsir.v80i10.46870.

  • Singh, V & Kaushik, V D, DTCWTASODCNN: DTCWT based weighted fusion model for multimodal medical image quality improvement with ASO technique & DCNN, J Sci Ind Res, 81(08) (2022) 850–858, Doi: 10.56042/ jsir.v81i08.56203.


Abstract Views: 46

PDF Views: 62




  • Haar Adaptive Taylor-ASSCA-DCNN: A Novel Fusion Model for Image Quality Enhancement

Abstract Views: 46  |  PDF Views: 62

Authors

Vineeta Singh
Department of Computer Science and Engineering, Harcourt Butler Technical University, East Campus, Nawabganj, Kanpur, Uttar Pradesh 208 002, India., India
Vandana Dixit Kaushik
Department of Computer Science and Engineering, Harcourt Butler Technical University, East Campus, Nawabganj, Kanpur, Uttar Pradesh 208 002, India., India

Abstract


In medical imaging, image fusion has a prominent exposure in extracting complementary information out of varying medical image modalities. The utilization of different medical image modality had imperatively improved treatment information. Each kind of modality contains specific data regarding subject being imaged. Various techniques are devised for solving the issue of fusion, but the major issue of these techniques is key features loss in fused image, which also leads to unwanted artefacts. This paper devises an Adaptive optimization driven deep model fusing for medical images to obtain the essential information for diagnosis and research purpose. Through our proposed fusion scheme based on Haar wavelet and Adaptive Taylor ASSCA Deep CNN wehave developed fusion rules to amalgamate pairs of Magnetic Resonance Imaging i.e. MRI like T1, T2. Through experimental analysis our proposed method shown for preserving edge as well as component related information moreover tumour detection efficiency has also been increased. Here, as input, two MRI images have been considered. Then Haarwavelet is adapted on both MRI imagesfor transformation of images in low as well as high frequency sub-groups. Then, the fusion is done withcorrelation-based weighted model. After fusion, produced output is imposed to final fusion, which is executed through Deep Convolution Neural Network (DCNN). The Deep CNN is trained here utilizing Adaptive Taylor Atom Search Sine Cosine Algorithm (Adaptive Taylor ASSCA). Here, the Adaptive Taylor ASSCA is obtained by integrating adaptive concept in Taylor ASSCA. The highest MI of 1.672532 have been attained using db2 wavelet for image pair 1, highest PSNR 42.20993dB using db 2 wavelet for image pair 5 and lowest RMSE 5.204896 using sym 2 wavelet for image pair 5, havebeen shown proposed Adaptive Taylor ASO + SCA-based Deep CNN.

Keywords


Correlation-Based Weighted Model, Deepmodel, Haar Wavelet, Magnetic Resonance Imaging (MRI), Medical Image Fusion.

References