HDTFF-Net: Hierarchical Deep Texture Features Fusion Network for High-Resolution Remote Sensing Scene Classification

被引:6
作者
Song, Wanying [1 ]
Cong, Yifan [1 ]
Zhang, Shiru [1 ]
Wu, Yan [2 ]
Zhang, Peng [2 ]
机构
[1] Xian Univ Sci & Technol, Sch Commun & Informat Engn, Xian Key Lab Network Convergence Commun, Xian 710054, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
基金
中国博士后科学基金;
关键词
Index Terms-Convolutional neural network (CNN); deep Gabor features; deep wavelet features; Dempster-Shafer (D-S) evidential theory; remote sensing scene classification (RSSC); ATTENTION; SCALE;
D O I
10.1109/JSTARS.2023.3298492
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Fusing features from different feature descriptors or different convolutional layers can improve the understanding of scene and enhance the classification accuracy. In this article, we propose a hierarchical deep texture feature fusion network, abbreviated as HDTFF-Net, aiming to improve the classification accuracy of high-resolution remote sensing scene classification. The proposed HDTFF-Net can effectively combine the shallow texture information from manual features and the deep texture information by convolutional neural networks (CNNs). First, for deeply excavating the multiscale and multidirectional shallow texture features in images, an improved Wavelet feature extraction module and a Gabor feature extraction module are designed by fully fusing the structural features into the backbone neural network. Then, to make the output texture features more discriminative and interpretative, we incorporate the above texture feature extraction modules into traditional CNNs (Tra-CNNs), and design two improved deep networks, namely Wave-CNN and Gabor-CNN. Finally, according to the Dempster-Shafer evidence theory, the designed Wave-CNN and Gabor-CNN are fused with the Tra-CNN by a decision-level fusion strategy, which can effectively capture the deep texture features by different feature descriptors and improve the classification performance. Experiments on high-resolution remote sensing images demonstrate the effectiveness of the proposed HDTFF-Net, and verify that it can greatly improve the classification performance.
引用
收藏
页码:7327 / 7342
页数:16
相关论文
共 50 条
[21]   Fusing Local and Global Features for High-Resolution Scene Classification [J].
Bian, Xiaoyong ;
Chen, Chen ;
Tian, Long ;
Du, Qian .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (06) :2889-2901
[22]   Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification [J].
Chen, Xiaoning ;
Ma, Mingyang ;
Li, Yong ;
Cheng, Wei .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :12429-12439
[23]   Hierarchical feature coding model for high-resolution satellite scene classification [J].
Zhao, Feng'an ;
Mu, Xiaodong ;
Yang, Zhou ;
Yi, Zhaoxiang .
JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (01)
[24]   Interactive Multiscale Classification of High-Resolution Remote Sensing Images [J].
dos Santos, Jefersson Alex ;
Gosselin, Philippe-Henri ;
Philipp-Foliguet, Sylvie ;
Torres, Ricardo da S. ;
Falcao, Alexandre Xavier .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2013, 6 (04) :2020-2034
[25]   Robust Object Categorization and Scene Classification over Remote Sensing Images via Features Fusion and Fully Convolutional Network [J].
Ghadi, Yazeed Yasin ;
Rafique, Adnan Ahmed ;
al Shloul, Tamara ;
Alsuhibany, Suliman A. ;
Jalal, Ahmad ;
Park, Jeongmin .
REMOTE SENSING, 2022, 14 (07)
[26]   Semantic Classification of High-Resolution Remote-Sensing Images Based on Mid-level Features [J].
Zhang, Junping ;
Li, Tong ;
Lu, Xiaochen ;
Cheng, Zhen .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2016, 9 (06) :2343-2353
[27]   Remote Sensing Scene Image Classification Based on Dense Fusion of Multi-level Features [J].
Shi, Cuiping ;
Zhang, Xinlei ;
Sun, Jingwei ;
Wang, Liguo .
REMOTE SENSING, 2021, 13 (21)
[28]   A Distributed System Architecture for High-resolution Remote Sensing Image Retrieval by Combining Deep and Traditional Features [J].
Cheng, Qimin ;
Shao, Kang ;
Li, Chengyuan ;
Li, Sen ;
Li, Jinling ;
Shao, Zhenfeng .
IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXIV, 2018, 10789
[29]   Land-cover classification with high-resolution remote sensing images using transferable deep models [J].
Tong, Xin-Yi ;
Xia, Gui-Song ;
Lu, Qikai ;
Shen, Huanfeng ;
Li, Shengyang ;
You, Shucheng ;
Zhang, Liangpei .
REMOTE SENSING OF ENVIRONMENT, 2020, 237
[30]   MSE-Net: A novel master-slave encoding network for remote sensing scene classification [J].
Yue, Hongguang ;
Qing, Linbo ;
Zhang, Zhixuan ;
Wang, Zhengyong ;
Guo, Li ;
Peng, Yonghong .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 132