Semantic Segmentation and Edge Detection-Approach to Road Detection in Very High Resolution Satellite Images

被引:52
作者
Ghandorh, Hamza [1 ]
Boulila, Wadii [2 ,3 ]
Masood, Sharjeel [4 ]
Koubaa, Anis [2 ]
Ahmed, Fawad [5 ]
Ahmad, Jawad [6 ]
机构
[1] Taibah Univ, Coll Comp Sci & Engn, Medina 42353, Saudi Arabia
[2] Prince Sultan Univ, Robot & Internet Things Lab, Riyadh 12435, Saudi Arabia
[3] Univ Manouba, Natl Sch Comp Sci, RIADI Lab, Manouba 2010, Tunisia
[4] HealthHub, Seoul 06524, South Korea
[5] NUST, Pakistan Navy Engn Coll, Dept Cyber Secur, Islamabad 75350, Pakistan
[6] Edinburgh Napier Univ, Sch Comp, Edinburgh EH10 5DT, Midlothian, Scotland
关键词
deep learning; convolutional neural networks; 2D attention; satellite images; road segmentation; edge detection; EFFECTIVE RECEPTIVE-FIELD; EXTRACTION; NETWORK;
D O I
10.3390/rs14030613
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Road detection technology plays an essential role in a variety of applications, such as urban planning, map updating, traffic monitoring and automatic vehicle navigation. Recently, there has been much development in detecting roads in high-resolution (HR) satellite images based on semantic segmentation. However, the objects being segmented in such images are of small size, and not all the information in the images is equally important when making a decision. This paper proposes a novel approach to road detection based on semantic segmentation and edge detection. Our approach aims to combine these two techniques to improve road detection, and it produces sharp-pixel segmentation maps, using the segmented masks to generate road edges. In addition, some well-known architectures, such as SegNet, used multi-scale features without refinement; thus, using attention blocks in the encoder to predict fine segmentation masks resulted in finer edges. A combination of weighted cross-entropy loss and the focal Tversky loss as the loss function is also used to deal with the highly imbalanced dataset. We conducted various experiments on two datasets describing real-world datasets covering the three largest regions in Saudi Arabia and Massachusetts. The results demonstrated that the proposed method of encoding HR feature maps effectively predicts sharp segmentation masks to facilitate accurate edge detection, even against a harsh and complicated background.
引用
收藏
页数:22
相关论文
共 52 条
[21]   A Deep Learning-Based Solution for Large-Scale Extraction of the Secondary Road Network from High-Resolution Aerial Orthoimagery [J].
Cira, Calimanut-Ionut ;
Alcarria, Ramon ;
Manso-Callejo, Miguel-Angel ;
Serradilla, Francisco .
APPLIED SCIENCES-BASEL, 2020, 10 (20) :1-18
[22]  
Emara T., 2019 DIG IM COMP TEC, DOI [10.1109/dicta47822.2019.8945975, DOI 10.1109/DICTA47822.2019.8945975]
[23]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[24]   Effective Use of Dilated Convolutions for Segmenting Small Object Instances in Remote Sensing Imagery [J].
Hamaguchi, Ryuhei ;
Fujita, Aito ;
Nemoto, Keisuke ;
Imaizumi, Tomoyuki ;
Hikosaka, Shuhei .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :1442-1450
[25]   Remote Sensing Image Semantic Segmentation Based on Edge Information Guidance [J].
He, Chu ;
Li, Shenglin ;
Xiong, Dehui ;
Fang, Peizhang ;
Liao, Mingsheng .
REMOTE SENSING, 2020, 12 (09)
[26]   HED-UNet: Combined Segmentation and Edge Detection for Monitoring the Antarctic Coastline [J].
Heidler, Konrad ;
Mou, Lichao ;
Baumhoer, Celia ;
Dietz, Andreas ;
Zhu, Xiao Xiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[27]   Road Segmentation in SAR Satellite Images With Deep Fully Convolutional Neural Networks [J].
Henry, Corentin ;
Azimi, Seyed Majid ;
Merkle, Nina .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (12) :1867-1871
[28]  
Li R., 2020, EESSIV200902130 ARXI
[29]   Understanding and improving deep learning-based rolling bearing fault diagnosis with attention mechanism [J].
Li, Xiang ;
Zhang, Wei ;
Ding, Qian .
SIGNAL PROCESSING, 2019, 161 :136-154
[30]   Road Extraction Methods in High-Resolution Remote Sensing Images: A Comprehensive Review [J].
Lian, Renbao ;
Wang, Weixing ;
Mustafa, Nadir ;
Huang, Liqin .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 (13) :5489-5507