A Multi-Scale Convolution and Multi-Layer Fusion Network for Remote Sensing Forest Tree Species Recognition

被引:14
作者
Hou, Jinjing [1 ]
Zhou, Houkui [2 ]
Hu, Junguo [2 ]
Yu, Huimin [3 ,4 ]
Hu, Haoji [4 ]
机构
[1] Zhejiang A&F Univ, Sch Math & Comp Sci, Hangzhou 311300, Peoples R China
[2] Zhejiang A&F Univ, Zhejiang Prov Key Lab Forestry Intelligent Monitor, Hangzhou 311300, Peoples R China
[3] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
[4] Zhejiang Univ, State Key Lab CAD & CG, Hangzhou 310027, Peoples R China
关键词
remote sensing; forest tree species; multi scale features; feature fusion; attention mechanism;
D O I
10.3390/rs15194732
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Forest tree species identification in the field of remote sensing has become an important research topic. Currently, few research methods combine global and local features, making it challenging to accurately handle the similarity between different categories. Moreover, using a single deep layer for feature extraction overlooks the unique feature information at intermediate levels. This paper proposes a remote sensing image forest tree species classification method based on the Multi-Scale Convolution and Multi-Level Fusion Network (MCMFN) architecture. In the MCMFN network, the Shallow Multi-Scale Convolution Attention Combination (SMCAC) module replaces the original 7 x 7 convolution at the first layer of ResNet-50. This module uses multi-scale convolution to capture different receptive fields, and combines it with the attention mechanism to effectively enhance the ability of shallow features and obtain richer feature information. Additionally, to make efficient use of intermediate and deep-level feature information, the Multi-layer Selection Feature Fusion (MSFF) module is employed to improve classification accuracy. Experimental results on the Aerial forest dataset demonstrate a classification accuracy of 91.03%. The comprehensive experiments indicate the feasibility and effectiveness of the proposed MCMFN network.
引用
收藏
页数:18
相关论文
共 30 条
[1]   TreeSatAI Benchmark Archive: a multi-sensor, multi-label dataset for tree species classification in remote sensing [J].
Ahlswede, Steve ;
Schulz, Christian ;
Gava, Christiano ;
Helber, Patrick ;
Bischke, Benjamin ;
Foerster, Michael ;
Arias, Florencia ;
Hees, Joern ;
Demir, Beguem ;
Kleinschmit, Birgit .
EARTH SYSTEM SCIENCE DATA, 2023, 15 (02) :681-695
[2]   Urban tree species mapping using hyperspectral and lidar data fusion [J].
Alonzo, Michael ;
Bookhagen, Bodo ;
Roberts, Dar A. .
REMOTE SENSING OF ENVIRONMENT, 2014, 148 :70-83
[3]  
Chen YP, 2017, Arxiv, DOI arXiv:1701.06772
[4]   Exploring Hierarchical Convolutional Features for Hyperspectral Image Classification [J].
Cheng, Gong ;
Li, Zhenpeng ;
Han, Junwei ;
Yao, Xiwen ;
Guo, Lei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (11) :6712-6722
[5]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[6]   Phenological differences in Tasseled Cap indices improve deciduous forest classification [J].
Dymond, CC ;
Mladenoff, DJ ;
Radeloff, VC .
REMOTE SENSING OF ENVIRONMENT, 2002, 80 (03) :460-472
[7]   Dual-Concentrated Network With Morphological Features for Tree Species Classification Using Hyperspectral Image [J].
Guo, Zhengqi ;
Zhang, Mengmeng ;
Jia, Wen ;
Zhang, Jinxin ;
Li, Wei .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :7013-7024
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (09) :1904-1916
[10]   REVISITING GRAPH CONVOLUTIONAL NETWORKS WITH MINI-BATCH SAMPLING FOR HYPERSPECTRAL IMAGE CLASSIFICATION [J].
Hong, Danfeng ;
Gao, Lianru ;
Wu, Xin ;
Yao, Jing ;
Zhang, Bing .
2021 11TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2021,