Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification

被引:10
作者
Chen, Xiaoning [1 ]
Ma, Mingyang [1 ]
Li, Yong [1 ]
Cheng, Wei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
关键词
Remote sensing; Collaboration; Training; Kernel; Dictionaries; Feature extraction; Sensors; Collaborative representation classification (CRC); feature fusion; kernel trick; remote sensing; scene classification; CONVOLUTIONAL NEURAL-NETWORK; SPARSE REPRESENTATION; IMAGE CLASSIFICATION; SCALE; RECOGNITION; MODEL;
D O I
10.1109/JSTARS.2021.3130073
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing scene classification is widely concerned because of its wide applications. Recently, convolutional neural networks (CNNs) have made a significant breakthrough in remote sensing image scene classification. However, the accuracy of using only a fully connected layer of CNNs as a classifier is not satisfied, especially for few-shot remote sensing images. In this article, we propose a feature-fusion-based kernel collaborative representation classification (FF-KCRC) framework for few-shot remote sensing images, which can make full use of the synergy between samples and the similarity between different types of image features to improve the accuracy of scene classification for few-shot remote sensing images. Specifically, we first design an effective feature extraction strategy to obtain more discriminative image features from CNNs, in which transfer learning is used to transfer the weights of pretrained CNNs to alleviate the few-shot training problem. Then, we design the FF-KCRC framework to make full use of the synergy between different categories and fuse the classification of different features, where "kernel trick" is used to address the problem of linear indivisibility. Extensive experiments have been conducted on publicly available remote sensing image datasets, and the results show that the proposed FF-KCRC achieves state-of-the-art results.
引用
收藏
页码:12429 / 12439
页数:11
相关论文
共 61 条
[21]   More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification [J].
Hong, Danfeng ;
Gao, Lianru ;
Yokoya, Naoto ;
Yao, Jing ;
Chanussot, Jocelyn ;
Du, Qian ;
Zhang, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (05) :4340-4354
[22]   An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing [J].
Hong, Danfeng ;
Yokoya, Naoto ;
Chanussot, Jocelyn ;
Zhu, Xiao Xiang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) :1923-1938
[23]  
Hsu PH, 2019, INT GEOSCI REMOTE SE, P2997, DOI [10.1109/IGARSS.2019.8898445, 10.1109/igarss.2019.8898445]
[24]   Rotation-Invariant Feature Learning in VHR Optical Remote Sensing Images via Nested Siamese Structure With Double Center Loss [J].
Jiang, Ruoqiao ;
Mei, Shaohui ;
Ma, Mingyang ;
Zhang, Shun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (04) :3326-3337
[25]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[26]   Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification [J].
Li, Erzhu ;
Xia, Junshi ;
Du, Peijun ;
Lin, Cong ;
Samat, Alim .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (10) :5653-5665
[27]   Deep Learning for Hyperspectral Image Classification: An Overview [J].
Li, Shutao ;
Song, Weiwei ;
Fang, Leyuan ;
Chen, Yushi ;
Ghamisi, Pedram ;
Benediktsson, Jon Atli .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (09) :6690-6709
[28]   Classification of High-Spatial-Resolution Remote Sensing Scenes Method Using Transfer Learning and Deep Convolutional Neural Network [J].
Li, Wenmei ;
Wang, Ziteng ;
Wang, Yu ;
Wu, Jiaqi ;
Wang, Juan ;
Jia, Yan ;
Gui, Guan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 (13) :1986-1995
[29]   Weighted Spatial Pyramid Matching Collaborative Representation for Remote-Sensing-Image Scene Classification [J].
Liu, Bao-Di ;
Meng, Jie ;
Xie, Wen-Yang ;
Shao, Shuai ;
Li, Ye ;
Wang, Yanjiang .
REMOTE SENSING, 2019, 11 (05)
[30]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110