Deep Spatial Feedback Refined Network With Multilevel Feature Fusion for Hyperspectral Image Subpixel Mapping

被引:2
作者
Zhong, Junfei [1 ]
Wu, Ke [1 ,2 ]
Xu, Ying [3 ]
机构
[1] China Univ Geosci, Sch Geophys & Geomat, Wuhan 430074, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, State Key Lab Remote Sensing Sci, Beijing 100101, Peoples R China
[3] Natl Satellite Ocean Applicat Serv, Beijing 100081, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Spatial resolution; Land surface; Hyperspectral imaging; Feature extraction; Superresolution; Laboratories; Correlation; Deep learning; feedback mechanism; hyperspectral image (HSI); multilevel feature fusion (MLFF); subpixel mapping (SPM); LAND-COVER; NEURAL-NETWORK; CLASSIFICATION;
D O I
10.1109/TGRS.2024.3419157
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The issue of mixed pixels is a prevalent challenge in hyperspectral images (HSIs), largely due to imaging modalities and hardware limitations. Subpixel mapping (SPM) can address this issue by distinguishing between land cover classes at a subpixel scale. In recent years, deep convolutional neural networks have demonstrated their potential and effectiveness for SPM. However, during the SPM process, the unique strengths of features at different network levels are often neglected, resulting in insufficient interaction between features at varying levels. Consequently, the network cannot fully extract and utilize the information from higher and lower level features nor can it thoroughly understand and recognize the input images. This ultimately hampers the model's SPM performance. In this study, we propose a deep spatial feedback refined network with multilevel feature fusion (SFRNet-MLFF) for SPM of hyperspectral remote sensing images. This innovative network incorporates a feedback mechanism and a multilevel feature fusion (MLFF) technique, both of which significantly enhance the interaction and aggregation of information across diverse features. Furthermore, throughout the entire network process, we apply solution space constraints to various spatial resolution contexts. These strategic implementations are expected to substantiate the network's performance in SPM. The experimental results on three hyperspectral datasets demonstrate that SFRNet-MLFF produces results with more distinct feature outlines. These results are better equipped to indicate the precise location and distribution patterns of land cover classes in low-resolution images at higher spatial resolutions. Furthermore, SFRNet-MLFF significantly improves the overall accuracy (OA) compared to the state-of-the-art deep learning SPM networks (DLSPMNets).
引用
收藏
页数:20
相关论文
共 61 条
[3]   Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Dobigeon, Nicolas ;
Parente, Mario ;
Du, Qian ;
Gader, Paul ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (02) :354-379
[4]  
Chen Chun-Fu., 2021, arXiv
[5]   Spatiotemporal Continuous Impervious Surface Mapping by Fusion of Landsat Time Series Data and Google Earth Imagery [J].
Chen, Rui ;
Li, Xiaodong ;
Zhang, Yihang ;
Zhou, Pu ;
Wang, Yalan ;
Shi, Lingfei ;
Jiang, Lai ;
Ling, Feng ;
Du, Yun .
REMOTE SENSING, 2021, 13 (12)
[6]   The mixed pixel effect in land surface phenology: A simulation study [J].
Chen, Xiang ;
Wang, Dawei ;
Chen, Jin ;
Wang, Cong ;
Shen, Miaogen .
REMOTE SENSING OF ENVIRONMENT, 2018, 211 :338-344
[7]   Realistic Mixing Miniature Scene Hyperspectral Unmixing: From Benchmark Datasets to Autonomous Unmixing [J].
Cui, Chunyang ;
Zhong, Yanfei ;
Wang, Xinyu ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[8]   Semi-MCNN: A Semisupervised Multi-CNN Ensemble Learning Method for Urban Land Cover Classification Using Submeter HRRS Images [J].
Fan, Runyu ;
Feng, Ruyi ;
Wang, Lizhe ;
Yan, Jining ;
Zhang, Xiaohan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :4973-4987
[9]   Very fine spatial resolution urban land cover mapping using an explicable sub-pixel mapping network based on learnable spatial correlation [J].
He, Da ;
Shi, Qian ;
Xue, Jingqian ;
Atkinson, Peter M. ;
Liu, Xiaoping ;
Weiss, Marie .
REMOTE SENSING OF ENVIRONMENT, 2023, 299
[10]   Generating 2m fine-scale urban tree cover product over 34 metropolises in China based on deep context-aware sub-pixel mapping network [J].
He, Da ;
Shi, Qian ;
Liu, Xiaoping ;
Zhong, Yanfei ;
Zhang, Liangpei .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 106