Multilevel Feature Fusion Networks With Adaptive Channel Dimensionality Reduction for Remote Sensing Scene Classification

被引:35
作者
Wang, Xin [1 ]
Duan, Lin [1 ]
Shi, Aiye [1 ]
Zhou, Huiyu [2 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Peoples R China
[2] Univ Leicester, Sch Informat, Leicester LE1 7RH, Leics, England
关键词
Feature extraction; Dimensionality reduction; Convolution; Semantics; Remote sensing; Task analysis; Spatial resolution; Adaptive channel dimensionality reduction (ACR); convolutional neural networks (CNNs); multilevel feature fusion (MLFF); remote sensing (RS) scene classification;
D O I
10.1109/LGRS.2021.3070016
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Scene classification in very high-resolution (VHR) remote sensing (RS) images is a challenging task due to the complex and diverse content of the images. Recently, convolution neural networks (CNNs) have been utilized to tackle this task. However, CNNs cannot fully meet the needs of scene classification due to clutters and small objects in VHR images. To handle these challenges, this letter presents a novel multilevel feature fusion (MLFF) network with adaptive channel dimensionality reduction for RS scene classification. Specifically, an adaptive method is designed for channel dimensionality reduction of high-dimensional features. Then, an MLFF module is introduced to fuse the features in an efficient way. Experiments on three widely used data sets show that our model outperforms several state-of-the-art methods in terms of both accuracy and stability.
引用
收藏
页数:5
相关论文
共 24 条
[1]  
[Anonymous], 2017, P IEEE, DOI DOI 10.1109/JPROC.2017.2675998
[2]   Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification [J].
Anwer, Rao Muhammad ;
Khan, Fahad Shahbaz ;
van de Weijer, Joost ;
Molinier, Matthieu ;
Laaksonen, Jorma .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 138 :74-85
[3]   Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification [J].
Cao, Ran ;
Fang, Leyuan ;
Lu, Ting ;
He, Nanjun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (01) :43-47
[4]   Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities [J].
Cheng, Gong ;
Xie, Xingxing ;
Han, Junwei ;
Guo, Lei ;
Xia, Gui-Song .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :3735-3756
[5]   Scene Classification of Remote Sensing Images Based on Saliency Dual Attention Residual Network [J].
Guo, Dongen ;
Xia, Ying ;
Luo, Xiaobo .
IEEE ACCESS, 2020, 8 :6344-6357
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   Skip-Connected Covariance Network for Remote Sensing Scene Classification [J].
He, Nanjun ;
Fang, Leyuan ;
Li, Shutao ;
Plaza, Javier ;
Plaza, Antonio .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (05) :1461-1474
[8]   Remote Sensing Scene Classification Using Multilayer Stacked Covariance Pooling [J].
He, Nanjun ;
Fang, Leyuan ;
Li, Shutao ;
Plaza, Antonio ;
Plaza, Javier .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (12) :6899-6910
[9]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[10]   Combining Multilevel Features for Remote Sensing Image Scene Classification With Attention Model [J].
Ji, Jinsheng ;
Zhang, Tao ;
Jiang, Linfeng ;
Zhong, Weilin ;
Xiong, Huilin .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (09) :1647-1651