GVANet: A Grouped Multiview Aggregation Network for Remote Sensing Image Segmentation

被引:1
作者
Yang, Yunsong [1 ]
Li, Jinjiang [1 ]
Chen, Zheng [1 ]
Ren, Lu [1 ]
机构
[1] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Accuracy; Semantic segmentation; Semantics; Convolutional neural networks; Buildings; Attention mechanism; multiscale fusion; remote sensing; semantic segmentation; transformer; CONVOLUTIONAL NEURAL-NETWORKS; SEMANTIC SEGMENTATION; CLASSIFICATION;
D O I
10.1109/JSTARS.2024.3459958
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In remote sensing image segmentation tasks, various challenges arise, including difficulties in recognizing objects due to differences in perspective, difficulty in distinguishing objects with similar colors, and challenges in segmentation caused by occlusions. To address these issues, we propose a method called the grouped multiview aggregation network (GVANet), which leverages multiview information for image analysis. This approach enables global multiview expansion and fine-grained cross-layer information interaction within the network. Within this network framework, to better utilize a wider range of multiview information to tackle challenges in remote sensing segmentation, we introduce the multiview feature aggregation block for extracting multiview information. Furthermore, to overcome the limitations of same-level shortcuts when dealing with multiview problems, we propose the channel group fusion block for cross-layer feature information interaction through a grouped fusion approach. Finally, to enhance the utilization of global features during the feature reconstruction phase, we introduce the aggregation-inhibition-activation block for feature selection and focus, which captures the key features for segmentation. Comprehensive experimental results on the Vaihingen and Potsdam datasets demonstrate that GVANet outperforms current state-of-the-art methods, achieving mIoU scores of 84.5% and 87.6%, respectively.
引用
收藏
页码:16727 / 16743
页数:17
相关论文
共 59 条
[11]   C-UNet: Complement UNet for Remote Sensing Road Extraction [J].
Hou, Yuewu ;
Liu, Zhaoying ;
Zhang, Ting ;
Li, Yujian .
SENSORS, 2021, 21 (06) :1-21
[12]   CCNet: Criss-Cross Attention for Semantic Segmentation [J].
Huang, Zilong ;
Wang, Xinggang ;
Huang, Lichao ;
Huang, Chang ;
Wei, Yunchao ;
Liu, Wenyu .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :603-612
[13]   GAF-Net: Improving the Performance of Remote Sensing Image Fusion using Novel Global Self and Cross Attention Learning [J].
Jha, Ankit ;
Bose, Shirsha ;
Banerjee, Biplab .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :6343-6352
[14]   Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning [J].
Kemker, Ronald ;
Salvaggio, Carl ;
Kanan, Christopher .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 145 :60-77
[15]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[16]   MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images [J].
Li, Rui ;
Duan, Chenxi ;
Zheng, Shunyi ;
Zhang, Ce ;
Atkinson, Peter M. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[17]  
Li R, 2022, GEO-SPAT INF SCI, V25, P278, DOI [10.1080/10095020.2021.2017237, 10.1109/GLOBECOM48099.2022.10000918]
[18]   A2-FPN for semantic segmentation of fine-resolution remotely sensed images [J].
Li, Rui ;
Wang, Libo ;
Zhang, Ce ;
Duan, Chenxi ;
Zheng, Shunyi .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (03) :1131-1155
[19]   Multistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images [J].
Li, Rui ;
Zheng, Shunyi ;
Duan, Chenxi ;
Su, Jianlin ;
Zhang, Ce .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[20]   Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images [J].
Li, Rui ;
Zheng, Shunyi ;
Zhang, Ce ;
Duan, Chenxi ;
Su, Jianlin ;
Wang, Libo ;
Atkinson, Peter M. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60