Development of deep learning-based hyperspectral remote sensing image unmixing

被引:0
作者
Su Y. [1 ,2 ]
Xu R. [1 ]
Gao L. [2 ]
Han Z. [2 ,3 ]
Sun X. [2 ]
机构
[1] College of Geomatic, Xi’an University of Science and Technology, Xi’an
[2] Key Laboratory of Computational Optical Imaging Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing
[3] University of Chinese Academy of Sciences, Beijing
基金
中国国家自然科学基金;
关键词
deep learning; deep neural network; hyperspectral remote sensing; machine learning; remote sensing image processing; remote sensing intelligent interpretation; subpixel interpretation; unmixing;
D O I
10.11834/jrs.20243165
中图分类号
学科分类号
摘要
Hyperspectral remote sensing is an advanced technique for earth observation that combines physical imagery and spectral analysis technology. Therefore, hyperspectral remote sensing can obtain fine spectral and rich spatial information from imaged scenes, merging the spatial and spectral information into data cubes. These data cubes exhibit narrow spectral bands and a high spectral resolution, allowing different land cover objects to be distinguished. Hyperspectral remote sensing images, with their high spectral resolution and cube characteristics, have gradually become among the most essential supporting data in remote sensing engineering applications. However, due to spatial resolution limitations, the mixed pixel problem has hindered the development of hyperspectral remote sensing in fine-scale object information extraction. At present, hyperspectral unmixing is one of the most effective analytical techniques for dealing with mixed pixel problems, aiming to break through spatial resolution limitations by analyzing the components within pixels. Hyperspectral unmixing refers to any process that separates pixel spectra from a hyperspectral image into a collection of pure constituent spectra, called endmembers, and a set of corresponding abundance fractions. At each pixel, the endmembers are generally assumed to represent the pure materials in the scene, while the abundances represent the percentage of each endmember. For the fine-scale interpretation of object information, many unmixing methods have been developed for hyperspectral remote sensing images in the remote sensing field over the past 30 years, mitigating the impact of mixed pixel problems on quantitative remote sensing analysis. Currently, with the development of deep learning, an increasing number of deep learning theories and tools are used to deal with mixed pixel problems. Many new methods using deep learning for unmixing have been developed, and unmixing technology research has gradually entered a new stage of development with deep learning. Deep-learning-based methods make better use of hidden information, have a relatively lower dependence on prior knowledge, and have a stronger adaptability to complex scenes than traditional unmixing methods. Although deep learning-based unmixing methods have developed rapidly in recent years and are diverse, the analysis and summary of the work on such methods have not kept up with the pace of technological development. A timely summary of the latest research progress on developing a specific field of research has a significant role in promoting the technology. Thus, this paper sorts out the existing deep learning-based unmixing methods, classifying them according to the adopted spectral mixing models, the deep network training modes, and whether spectral variability is considered. Furthermore, this paper introduces these deep learning-based approaches and summarizes their characteristics, making the use of these methods in special works convenient for users or readers. Finally, the development of deep learning methods is summarized, referring to the current technical status, characteristics, and development prospects. In addition, some existing deep learning unmixing methods were tested in this study and organized to facilitate the research and application of unmixing technology. The development of deep learning will continue to promote the progress of unmixing techniques. In recent years, deep learning-based unmixing methods have developed rapidly and have been gradually used in vegetation distribution investigation and agricultural yield estimation, implying their good development prospect and application value. his paper can provide valuable references for researching unmixing technology in the future. © 2024 Science Press. All rights reserved.
引用
收藏
页码:1 / 19
页数:18
相关论文
共 80 条
[1]  
Bioucas-Dias J M, Plaza A, Camps-Valls G, Scheunders P, Nasrabadi N, Chanussot J., Hyperspectral remote sensing data analysis and future challenges, IEEE Geoscience and Remote Sensing Magazine, 1, 2, pp. 6-36, (2013)
[2]  
Bioucas-Dias J M, Plaza A, Dobigeon N, Parente M, Du Q, Gader P, Chanussot J., Hyperspectral unmixing overview: geometrical, statistical, and sparse regression-based approaches, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 5, 2, pp. 354-379, (2012)
[3]  
Borsoi R A, Imbiriba T, Bermudez J C M., Deep generative endmember modeling: an application to unsupervised spectral unmixing, IEEE Transactions on Computational Imaging, 6, pp. 374-384, (2020)
[4]  
Chen J, Gamba P, Li J., MAHUM: a multitasks autoencoder hyperspectral unmixing model, IEEE Transactions on Geoscience and Remote Sensing, 61, (2023)
[5]  
Chen J, Zhao M, Wang X H, Richard C, Rahardja S., Integration of physics-based and data-driven models for hyperspectral image unmixing: a summary of current methods, IEEE Signal Processing Magazine, 40, 2, pp. 61-74, (2023)
[6]  
Cui C Y, Wang X Y, Wang S Y, Zhang L P, Zhong Y F., Unrolling nonnegative matrix factorization with group sparsity for blind hyperspectral unmixing, IEEE Transactions on Geoscience and Remote Sensing, 61, (2023)
[7]  
Dobigeon N, Tourneret J Y, Richard C, Bermudez J C M, McLaughlin S, Hero A O., Nonlinear unmixing of hyperspectral images: models and algorithms, IEEE Signal Processing Magazine, 31, 1, pp. 82-94, (2014)
[8]  
Dou Z Y, Gao K, Zhang X D, Wang H, Wang J W., Hyperspectral unmixing using orthogonal sparse prior-based autoencoder with hyper-Laplacian loss and data-driven outlier detection, IEEE Transactions on Geoscience and Remote Sensing, 58, 9, pp. 6550-6564, (2020)
[9]  
Fang H, Li A H, Xu H X, Wang T., Sparsity-constrained deep nonnegative matrix factorization for hyperspectral unmixing, IEEE Geoscience and Remote Sensing Letters, 15, 7, pp. 1105-1109, (2018)
[10]  
Fang Y, Wang Y X, Xu L L, Zhuo R M, Wong A, Clausi D A., BCUN: Bayesian fully convolutional neural network for hyperspectral spectral unmixing, IEEE Transactions on Geoscience and Remote Sensing, 60, (2022)