A2-FPN for semantic segmentation of fine-resolution remotely sensed images

被引:113
作者
Li, Rui [1 ]
Wang, Libo [1 ]
Zhang, Ce [2 ,3 ]
Duan, Chenxi [4 ]
Zheng, Shunyi [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan, Peoples R China
[2] Univ Lancaster, Lancaster Environm Ctr, Lancaster, England
[3] UK Ctr Ecol & Hydrol, Lancaster, England
[4] Univ Twente, Fac Geoinformat Sci & Earth Observat ITC, Hengelosestr 99, NL-7514 AE Enschede, Netherlands
基金
中国国家自然科学基金;
关键词
semantic segmentation; deep learning; attention mechanism; LAND-COVER; NETWORK;
D O I
10.1080/01431161.2022.2030071
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The thriving development of earth observation technology makes more and more high-resolution remote-sensing images easy to obtain. However, caused by fine-resolution, the huge spatial and spectral complexity leads to the automation of semantic segmentation becoming a challenging task. Addressing such an issue represents an exciting research field, which paves the way for scene-level landscape pattern analysis and decision-making. To tackle this problem, we propose an approach for automatic land segmentation based on the Feature Pyramid Network (FPN). As a classic architecture, FPN can build a feature pyramid with high-level semantics throughout. However, intrinsic defects in feature extraction and fusion hinder FPN from further aggregating more discriminative features. Hence, we propose an Attention Aggregation Module (AAM) to enhance multiscale feature learning through attention-guided feature aggregation. Based on FPN and AAM, a novel framework named Attention Aggregation Feature Pyramid Network (A(2)-FPN) is developed for semantic segmentation of fine-resolution remotely sensed images. Extensive experiments conducted on four datasets demonstrate the effectiveness of our A(2)-FPN in segmentation accuracy. Code is available at .
引用
收藏
页码:1131 / 1155
页数:25
相关论文
共 43 条
[1]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[2]   Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 140 :20-32
[3]   Comprehensively analyzing optical and polarimetric SAR features for land-use/land-cover classification and urban vegetation extraction in highly-dense urban area [J].
Bai, Yunkun ;
Sun, Guangmin ;
Li, Yu ;
Ma, Peifeng ;
Li, Gang ;
Zhang, Yuanzhi .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 103
[4]   Thick Cloud Removal of Remote Sensing Images Using Temporal Smoothness and Sparsity Regularized Tensor Optimization [J].
Duan, Chenxi ;
Pan, Jun ;
Li, Rui .
REMOTE SENSING, 2020, 12 (20) :1-26
[5]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[6]   A Semi-Supervised Deep Rule-Based Approach for Complex Satellite Sensor Image Analysis [J].
Gu, Xiaowei ;
Angelov, Plamen P. ;
Zhang, Ce ;
Atkinson, Peter M. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (05) :2281-2292
[7]   CE-Net: Context Encoder Network for 2D Medical Image Segmentation [J].
Gu, Zaiwang ;
Cheng, Jun ;
Fu, Huazhu ;
Zhou, Kang ;
Hao, Huaying ;
Zhao, Yitian ;
Zhang, Tianyang ;
Gao, Shenghua ;
Liu, Jiang .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (10) :2281-2292
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   Urban Land Cover Classification With Missing Data Modalities Using Deep Convolutional Neural Networks [J].
Kampffmeyer, Michael ;
Salberg, Arnt-Borre ;
Jenssen, Robert .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (06) :1758-1768
[10]   Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks [J].
Kampffmeyer, Michael ;
Salberg, Arnt-Borre ;
Jenssen, Robert .
PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, :680-688