MCAFNet: Multi-Channel Attention Fusion Network-Based CNN for Remote Sensing Scene Classification

被引:3
作者
Xia, Jingming [1 ]
Zhou, Yao [1 ]
Tan, Ling [1 ,2 ]
Ding, Yue
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Artificial Intelligence, Nanjing, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
关键词
Compendex;
D O I
10.14358/PERS.22-00121R2
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Remote sensing scene images are characterized by intra-class diversity and inter-class similarity. When recognizing remote sensing images, traditional image classification algorithms based on deep learning only extract the global features of scene images, ignoring the important role of local key features in classification, which limits the ability of feature expression and restricts the improvement of classification accuracy. Therefore, this paper presents a multi-channel attention fusion network (MCAFNet). First, three channels are used to extract the features of the image. The channel "spatial attention module" is added after the maximum pooling layer of two channels to get the global and local key features of the image. The other channel uses the original model to extract the deep features of the image. Second, features extracted from different channels are effectively fused by the fusion module. Finally, an adaptive weight loss function is designed to automatically adjust the losses in different types of loss functions. Three challenging data sets, UC Merced Land-Use Dataset (UCM), Aerial Image Dataset (AID), and Northwestern Polytechnic University Dataset (NWPU), are selected for the experiment. Experimental results show that our algorithm can effectively recognize scenes and obtain competitive classification results.
引用
收藏
页码:183 / 192
页数:10
相关论文
共 36 条
[1]   Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification [J].
Cao, Ran ;
Fang, Leyuan ;
Lu, Ting ;
He, Nanjun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (01) :43-47
[2]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[3]   Remote sensing scene classification based on high-order graph convolutional network [J].
Gao, Yue ;
Shi, Jun ;
Li, Jun ;
Wang, Ruoyu .
EUROPEAN JOURNAL OF REMOTE SENSING, 2021, 54 (54) :141-155
[4]   Forest Fire Segmentation from Aerial Imagery Data Using an Improved Instance Segmentation Model [J].
Guan, Zhihao ;
Miao, Xinyu ;
Mu, Yunjie ;
Sun, Quan ;
Ye, Qiaolin ;
Gao, Demin .
REMOTE SENSING, 2022, 14 (13)
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]   Skip-Connected Covariance Network for Remote Sensing Scene Classification [J].
He, Nanjun ;
Fang, Leyuan ;
Li, Shutao ;
Plaza, Javier ;
Plaza, Antonio .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (05) :1461-1474
[7]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
[8]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[9]   Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data [J].
Huang, Zhongling ;
Pan, Zongxu ;
Lei, Bin .
REMOTE SENSING, 2017, 9 (09)
[10]   Sea Ice-Water Classification of RADARSAT-2 Imagery Based on Residual Neural Networks (ResNet) with Regional Pooling [J].
Jiang, Mingzhe ;
Xu, Linlin ;
Clausi, David A. .
REMOTE SENSING, 2022, 14 (13)