ICTACT Journal on Soft Computing

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

A Deep Learning Approach for Road Extraction from Remote Sensing Imagery


Affiliations
1 Department of Electronics and Communication Engineering, Aliah University, India
2 Department of Electrical Engineering, Indian Institute of Technology, Dhanbad, India
3 Department of Electrical Engineering, RCC Institute of Information Technology, India
     

   Subscribe/Renew Journal


In recent years, Deep Learning (DL) is proving very successful set of tools for several image analysis, segmentation, and classification tasks. In this paper an automated Deep Learning Architecture (DLA) called the Deep Belief Neural Networks (DBN) stacked by Restricted Boltzmann Machines (RBMs), is designed, implemented, and experimentally evaluated for extracting semantic maps of roads in Remote Sensing (RS) images. Representative features are extracted by unsupervised pre-training of DBN and supervised fine-tuning phase. A Logistic Regression (LR) is added to the end of feature learning system to constitute a DBN-LR architecture. This LR classifier is employed to fine-tune the whole pre-trained network in a supervised way and classifies the patches from RS images. The features extracted from the image patches are fed to the architecture as input and it produces the class labels as a probability matrix as either a positive sample (road) or a negative sample (non-road). A math morphology algorithm is used to improve DBN performance during post processing. Experiments are conducted on a dataset of 970 RS scene images of urban and suburban areas to demonstrate the performance of the proposed network architecture. The proposed deep model resulted in an Overall Accuracy (OA) of 96.57% and F1-score of 0.9552. The results of the proposed architectures are compared with those of other network architectures. Experimental results demonstrate the effective performance of the proposed method for extracting roads from a complex scene.

Keywords

Remote Sensing Imagery, Road Networks Extraction, Deep Learning, Deep Belief Network, Restricted Boltzmann Machine
Subscription Login to verify subscription
User
Notifications
Font Size

  • Md. Abdul Alim Sheikh, Alok Kole and Tanmoy Maity, “A Multi-level Approach for Change Detection of Buildings using Satellite Imagery”, International Journal of Artificial Intelligence Tools, Vol. 27, No. 8, pp. 1850031-1850045, 2018.

  • Zhongbin Li, Wenzhong Shi, Qunming Wang and Zelang Miao, “Extracting Man-Made Objects from Remote Sensing Images via Fast Level Set Evolutions”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 2, pp. 883-899, 2015.

  • Z. Zhang, Q. Liu and Y.Wang, “Road Extraction by Deep Residual U-net”, IEEE Geoscience and Remote Sensing Letters, Vol. 15, No. 5, pp. 749-753, 2018.

  • Sukhendu Das, T. T. Mirnalinee, and Koshy Varghese, “Use of Salient Features for the Design of a Multistage Framework to Extract Roads from High-Resolution Multispectral Satellite Images”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 49, No.10, pp. 3906-3931, 2011.

  • P.P. Singh and R.D. Garg., “A Two-Stage Framework for Road Extraction from High-Resolution Satellite Images by using Prominent Features of Impervious Surfaces”, International Journal of Remote Sensing, Vol. 35, No. 24, pp. 8074-8107, 2014.

  • T. Panboonyuen, K. Jitkajornwanich, S. Lawawirojwong, P. Srestasathiern and P. Vateekul, “Road Segmentation of Remotely-Sensed Images using Deep Convolutional Neural Networks with Landscape Metrics and Conditional Random Fields”, Remote Sensing, Vol. 9, No. 7, pp 680-699, 2017.

  • G.E. Hinton ,S. Osindero and Y.W. Teh, “A Fast Learning Algorithm for Deep Belief Nets”, Neural Computing, Vol. 18, No. 7, pp. 1527-1554, 2006.

  • G.E. Hinton and R.R. Salakhutdinov, “Reducing the Dimensionality of Data with Neural Networks”, Science, Vol. 313, No. 5786, pp. 504-507, 2006.

  • Na Lu, T. Li, X. Ren and H. Miao, “A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzman Machines”, IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 25, No. 6, pp. 1-13, 2017.

  • Weixing Wang, Nan Yang, Yi Zhang, Fengping Wang, Ting Cao, Patrik Eklund, “A review of road extraction from remote sensing images”, Journal of traffic and Transportation Engineering, Vo. 3, No. 3, pp. 271-282, 2016.

  • Zhaoli Hong, Dongping Ming, Keqi Zhou, Ya Guo, and Tingting Lu, “Road Extraction From a High Spatial Resolution Remote Sensing Image Based on Richer Convolutional Features”, IEEE Access, Vol. 6, pp. 46988 –47000, 2018. DOI: 10.1109/ACCESS.2018.2867210.

  • Miao, Z.L., Wang, B., Shi, W., et al., “A semi-automatic method for road centerline extraction from VHR images”, IEEE Geoscience and Remote Sensing Letters, Vol. 11, No. 11, pp. 1856-1860, 2014.

  • Cem Unsalan and Beril Sirmacek, “Road Network Detection using Probabilistic and Graph Theoretical Methods”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 50, No.11, pp. 4441-4453, 2012.

  • Rasha Alshehhi and Prashanth Reddy Marpu, “Hierarchical Graph-Based Segmentation for Extracting Road Networks from High-Resolution Satellite Images”, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 126, pp. 245-260, 2017.

  • T. Peng, I. Prinet and J. Zerubia, “Incorporating Generic and Specific Prior Knowledge in a Multi-Scale Phase Field Model for Road Extraction from VHR Image”, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 1, No. 2, pp.139-146, 2008.

  • Z. Sun, H. Fang, M. Deng, A. Chen, P. Yue, and L. Di, “Regular Shape Similarity Index, A Novel Index for Accurate Extraction of Regular Objects from Remote Sensing Images”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 53, No. 7, pp. 3737-3748, 2015.

  • D. Chaudhuri, N.K. Kushwaha and A. Samal, “Semi-Automated Road Detection from High Resolution Satellite Images by Directional Morphological Enhancement and Segmentation Techniques”, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 5, No. 5, pp. 1538-1544, 2012.

  • S. Leninisha and K. Vani, “Water Flow based Geometric Active Deformable Model for Road Network”, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 102, pp. 140-147, 2015.

  • M. Amo, F. Martinez and M. Torre, “Road Extraction from Aerial Images using a Region Competition Algorithm”, IEEE Transactions on Image Processing, Vol. 15, No. 5, pp. 1192-1201, 2006.

  • S. Movaghati and A. Moghaddamjoo and A. Tavakoli, “Road Extraction from Satellite Images using Particle Filtering and Extended Kalman Filtering”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 48, No. 7, pp. 2807-2817, 2010.

  • J. Liu, Q. Qin, J. Li and Y. Li, “Rural Road Extraction from High-Resolution Remote Sensing Images based on Geometric Feature Inference”, International Society for Photogrammetry and Remote Sensing, Vol. 6, No. 10, pp. 314-337, 2017.

  • Mehdi Maboudi, Jalal Amini, Michael Hahn and Mehdi Saati, “Object-Based Road Extraction from Satellite Images using Ant Colony Optimization”, International Journal of Remote Sensing, Vol. 38, No. 1, pp. 179-198, 2017.

  • Mehdi Maboudi, Jalal Amini, Shirin Malihi and Michael Hahn., “Integrating Fuzzy Object based Image Analysis and Ant Colony Optimization for Road Extraction from Remotely Sensed Images”, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 138, pp. 151-163, 2018.

  • M.O. Sghaier and R. Lepage, “Road Extraction from very High Resolution Remote Sensing Optical Images based on Texture Analysis and Beamlet Transform”, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 9, No. 5, pp. 1946-1958, 2016.

  • Zelang M Iao, Bin Wang, Wenzhong Shi and Hao Wu, “A Method for Accurate Road Center line Extraction from a Classified Image”, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 7, No. 12, pp. 4762-4771, 2014.

  • C. Poullis, “Tensor-Cuts: A Simultaneous Multi-Type Feature Extractor and Classifier and its Application to Road Extraction from Satellite Images”, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 95, pp. 93-108, 2014.

  • Jun Wang, Jingwei Song, Mingquan Chen & Zhi Yang, “Road Network Extraction, A Neural-Dynamic Framework based on Deep Learning and a Finite State Machine”, International Journal of Remote Sensing, Vol. 36, No. 12, pp. 3144-3169, 2015.

  • Zhengxin Zhang, Qingjie Liu and Yunhong Wang, “Road Extraction by Deep Residual U-Net”, IEEE Geoscience and Remote Sensing Letters, Vol. 15, No. 5, pp. 749-753, 2018.

  • R. Alshehhi and M.D. Mura, “Simultaneous Extraction of Roads and Buildings in Remote Sensing Imagery with Convolutional Neural Networks”, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 130 pp. 139-149, 2017.

  • S. Saito, T. Yamashita and Y. Aoki, “Multiple Object Extraction from Aerial Imagery with Convolutional Neural Networks”, Electronic Imaging, Vol. 60, No. 1, pp. 1-9, 2016.

  • G. Fu, C. Liu, R. Zhou, T. Sun and Q. Zhang, “Classification for High Resolution Remote Sensing Imagery using a Fully Convolutional Network”, Remote Sensing, Vol. 9, No. 5, pp. 498-519, 2017.

  • A. Abdullah, B. Pradhan, N. Shukla, S. Chakraborty and A. Alarming, “Deep Learning Approaches to Remote Sensing Datasets for Road Extraction: A State-of-The - Art Review”, Remote Sensing, Vol. 12, No. 2, pp. 1444-1458, 2020.

  • Ruyi Liu, Qiguang Miao, Jianfeng Song, Yining Quan, Yunan Li, Pengfei Xu and Jing Dai, “Multiscale Road Center Lines Extraction from High-Resolution Aerial Imagery”, Neurocomputing, Vol. 329, pp. 384-396, 2019.

  • W. Zhao, S. Du and W.J. Emery, “Object-Based Convolutional Neural Network for High-Resolution Imagery Classification”, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, No. 7, pp. 3386-3396, 2017.

  • V. Mnih and G.E. Hinton, “Learning to Detect Roads in High‐Resolution Aerial Images”, Proceedings of the European Conference on Computer Vision, pp. 210-223, 2010.

  • E. Sarhan, E. Khalifa and A.M. Nabil, “Road Extraction Framework by using Cellular Neural Network from Remote Sensing Images”, Proceedings of International Conference on Image Information and Processing, pp. 1-5, 2011.

  • J.S.J. Wijesingha, “Automatic Road Feature Extraction from High Resolution Satellite Images using LVQ Neural Networks”, Asian Journal of Geoinformatics, Vol. 13, No. 1, pp. 30-36, 2013.

  • Y. Liu, M.M. Cheng, X. Hu, K.Wang and X. Bai, “Richer Convolutional Features for Edge Detection”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 5872-5881, 2017.

  • E. Maggiori and P. Alliez, “Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 55, pp. 645-657, 2017.

  • Z. Zhong, J. Li, W. Cui and H. Jiang, “Fully Convolutional Networks for Building and Road Extraction: Preliminary Results”, Proceedings of International Conference on Geoscience Remote Sensing, pp. 1591-1594, 2016.

  • G. Cheng, Y. Wang, S. Xu, H. Wang, S. Xiang and C. Pan, “Automatic Road Detection and Centerline Extraction Via Cascaded End-to-End Convolutional Neural Network”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 55, No. 6, pp. 3322 -3337, 2017.

  • R. Kestur and M. Mudigere, “A Fully Convolutional Neural Network for Road Extraction in RGB Imagery Acquired by Remote Sensing from an Unmanned Aerial Vehicle”, Journal of Applied Remote Sensing, Vo. 12, pp. 1-14, 2018.

  • T.T. Mirnalinee and Koshy Varghese, “An Integrated Multistage Framework for Automatic Road Extraction from High Resolution Satellite Imagery”, Journal of the Indian Society of Remote Sensing, Vol. 39, No. 1, pp. 1-25, 2011.

  • Xi Zhao Wang, T. Shang and R.Wang, “Noniterative Deep Learning: Incorporating Restricted Boltzmann Machine into Multilayer Random Weight Neural Networks”, IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 49, No. 7, pp. 1299-1308, 2019.

  • R.C Gonzalez and R.E Woods, “Digital Image Processing”, Prentice Hall, 2009.

  • F. Hu, G.S. Xiua, J. Hu and L. Zhang, “Transferring Deep Convolutional Neural Networks for Scene Classification of High-Resolution Remote Sensing Imagery”, Remote Sensing, Vol. 10, No. 11, pp. 14680-14707, 2015.

  • M. Wang and J.C. Luo, “Extracting roads based on Gauss Markov Random Field Texture Model and Support Vector Machine from High-Resolution RS Image”, IEEE Transaction on Geoscience and Remote Sensing, Vol. 9, No. 3, pp. 271-276, 2005.

  • I. Laptev and C. Steger, “Automatic Extraction of Roads from Aerial Images based on Scale Space and Snakes”, Machine Vision and Applications, Vol. 12, pp. 23-31, 2000.

  • P. Gamba, F. Dell Acqua and G. Lisini., “Improving Urban Road Extraction in High-Resolution Images Exploiting Directional Filtering, Perceptual Grouping, and Simple Topological Concepts”, IEEE Geoscience and Remote Sensing Letters, Vol. 3, No. 3, pp. 387-391, 2006.

  • F. Bastani, S. He, S. Abbar, M. Alizadeh, H. Balakrishnan, S. Chawla, S. Madden and D. DeWitt, “Automatic Extraction of Road Networks from Aerial Images”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 1-13, 2018.

  • L. Zhang, L. Zhang and B. Du, “Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art”, IEEE Geoscience and Remote Sensing Magazine, Vol. 4, No. 2, pp. 22-40, 2016.

  • Xiaofei Yang, Xutao Li, Yunming Ye and Raymond Y.K. Lau, “Road Detection and Centerline Extraction Via Deep Recurrent Convolutional Neural Network U-Net”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 57, No. 9, pp. 7209-7220, 2019.

  • J. Long and T. Darrell, “Fully Convolutional Networks for Semantic Segmentation”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1337-1342, 2015.

  • S. Valero, J. Benediktsson and Waske, B., “Advanced Directional Mathematical Morphology for the Detection of the Road Network in very High-Resolution Remote Sensing Images”, Pattern Recognition Letters, Vol. 31, No. 10, pp. 1120-1127, 2010.

  • Xiaofeng Han, Tao Jiang, Zifei Zhao and Zhongteng Lei, “Research on Remote Sensing Image Target Recognition Based on Deep Convolution Neural Network”, International Journal of Pattern Recognition and Artificial Intelligence, Vol. 34, No. 5, pp. 1-14, 2020.

  • Dexiang Zhang, Jingzhong Kang, Lina Xun and Yu Huang, “Hyperspectral Image Classification using Spatial and Edge Features Based on Deep Learning”, International Journal of Pattern Recognition and Artificial Intelligence, Vol. 33, No. 09, pp. 1-13, 2019.

  • Md. Abdul Alim Sheikh, Tanmoy Maity and Alok Kole, “Man-Made Object Extraction from Remote Sensing Images using Gabor Energy Features and Probabilistic Neural Networks”, ICTACT Journal on Image and Video Processing, Vol. 13, No. 2, pp. 2849-2859, 2022.


Abstract Views: 175

PDF Views: 2




  • A Deep Learning Approach for Road Extraction from Remote Sensing Imagery

Abstract Views: 175  |  PDF Views: 2

Authors

Md. Abdul Alim Sheikh
Department of Electronics and Communication Engineering, Aliah University, India
Tanmoy Maity
Department of Electrical Engineering, Indian Institute of Technology, Dhanbad, India
Alok Kole
Department of Electrical Engineering, RCC Institute of Information Technology, India

Abstract


In recent years, Deep Learning (DL) is proving very successful set of tools for several image analysis, segmentation, and classification tasks. In this paper an automated Deep Learning Architecture (DLA) called the Deep Belief Neural Networks (DBN) stacked by Restricted Boltzmann Machines (RBMs), is designed, implemented, and experimentally evaluated for extracting semantic maps of roads in Remote Sensing (RS) images. Representative features are extracted by unsupervised pre-training of DBN and supervised fine-tuning phase. A Logistic Regression (LR) is added to the end of feature learning system to constitute a DBN-LR architecture. This LR classifier is employed to fine-tune the whole pre-trained network in a supervised way and classifies the patches from RS images. The features extracted from the image patches are fed to the architecture as input and it produces the class labels as a probability matrix as either a positive sample (road) or a negative sample (non-road). A math morphology algorithm is used to improve DBN performance during post processing. Experiments are conducted on a dataset of 970 RS scene images of urban and suburban areas to demonstrate the performance of the proposed network architecture. The proposed deep model resulted in an Overall Accuracy (OA) of 96.57% and F1-score of 0.9552. The results of the proposed architectures are compared with those of other network architectures. Experimental results demonstrate the effective performance of the proposed method for extracting roads from a complex scene.

Keywords


Remote Sensing Imagery, Road Networks Extraction, Deep Learning, Deep Belief Network, Restricted Boltzmann Machine

References