Interpretable Hyperspectral Artificial Intelligence: When nonconvex modeling meets hyperspectral remote sensing

被引:201
作者
Hong, Danfeng [1 ,2 ,3 ]
He, Wei [4 ]
Yokoya, Naoto [5 ,6 ,7 ,8 ]
Yao, Jing [8 ,9 ,10 ]
Gao, Lianru [9 ,11 ,12 ]
Zhang, Liangpei [13 ,14 ,15 ]
Chanussot, Jocelyn [16 ,17 ,18 ,19 ,20 ,21 ,22 ]
Zhu, Xiaoxiang [5 ,22 ,23 ,24 ,25 ,26 ,27 ,28 ,29 ,30 ,31 ,32 ,33 ,34 ]
机构
[1] German Aerosp Ctr DLR, Remote Sensing Technol Inst IMF, Oberpfaffenhofen, Germany
[2] IMF DLR, Spectral Vis Working Grp, Oberpfaffenhofen, Germany
[3] Univ Grenoble Alpes, French Natl Ctr Sci Res, Grenoble Inst Technol, GIPSA Lab, F-38000 Grenoble, France
[4] RIKEN, Ctr Adv Intelligence Project, Tokyo 1030027, Japan
[5] Univ Tokyo, Tokyo 1030027, Japan
[6] RIKEN, Ctr Adv Intelligence Project, Geoinformat Unit, Tokyo 1030027, Japan
[7] German Aerosp Ctr, Oberpfaffenhofen, Germany
[8] Tech Univ Munich, Munich, Germany
[9] Chinese Acad Sci, Key Lab Digital Earth Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[10] German Aerosp Ctr, Remote Sensing Technol Inst, Oberpfaffenhofen, Germany
[11] Univ Extremadura, Caceres, Spain
[12] Mississippi State Univ, Starkville, MS USA
[13] Wuhan Univ, Minist Educ China, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430072, Peoples R China
[14] China State Key Basic Res Project, Beijing, Peoples R China
[15] Minist Natl Sci & Technol China, Remote Sensing Program China, Beijing, Peoples R China
[16] Grenoble INP, Grenoble, France
[17] Univ Iceland, Reykjavik, Iceland
[18] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[19] Stanford Univ, Stanford, CA 94305 USA
[20] Royal Inst Technol, Stockholm, Sweden
[21] Natl Univ Singapore, Singapore, Singapore
[22] Univ Calif Los Angeles, Los Angeles, CA USA
[23] TUM, Data Sci Earth Observat EO, Munich, Germany
[24] German Aerosp Ctr DLR, Remote Sensing Technol Inst, Signal Proc EO, Oberpfaffenhofen, Germany
[25] German Aerosp Ctr DLR, Remote Sensing Technol Inst, EO Data Sci Dept, Oberpfaffenhofen, Germany
[26] Munich Data Sci Res Sch, Munich, Germany
[27] Helmholtz Artificial Intelligence Res Field Aeron, Wessling, Germany
[28] Int Future Artificial Intelligence Lab Artificial, D-80333 Munich, Germany
[29] TUM, Munich Data Sci Inst, D-80333 Munich, Germany
[30] Italian Natl Res Council, Naples, Italy
[31] Fudan Univ, Shanghai, Peoples R China
[32] Berlin Brandenburg Acad Sci & Humanities, Junges Kolleg, Young Acad, Berlin, Germany
[33] German Natl Acad Sci Leopoldina, Halle, Germany
[34] Bavarian Acad Sci & Humanities, Munich, Germany
基金
中国国家自然科学基金; 日本学术振兴会;
关键词
Imaging; Artificial intelligence; Data models; Analytical models; Two dimensional displays; Task analysis; Earth; NONLINEAR DIMENSIONALITY REDUCTION; NONNEGATIVE MATRIX FACTORIZATION; LOW-RANK GRAPH; DISCRIMINANT-ANALYSIS; MULTISPECTRAL DATA; NEURAL-NETWORK; IMAGE-RESTORATION; SPARSE; ALGORITHM; SUPERRESOLUTION;
D O I
10.1109/MGRS.2021.3064051
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral (HS) imaging, also known as image spectrometry, is a landmark technique in geoscience and remote sensing (RS). In the past decade, enormous efforts have been made to process and analyze these HS products, mainly by seasoned experts. However, with an ever-growing volume of data, the bulk of costs in manpower and material resources poses new challenges for reducing the burden of manual labor and improving efficiency. For this reason, it is urgent that more intelligent and automatic approaches for various HS RS applications be developed. Machine learning (ML) tools with convex optimization have successfully undertaken the tasks of numerous artificial intelligence (AI)-related applications; however, their ability to handle complex practical problems remains limited, particularly for HS data, due to the effects of various spectral variabilities in the process of HS imaging and the complexity and redundancy of higher-dimensional HS signals. Compared to convex models, nonconvex modeling, which is capable of characterizing more complex real scenes and providing model interpretability technically and theoretically, has proven to be a feasible solution that reduces the gap between challenging HS vision tasks and currently advanced intelligent data processing models.
引用
收藏
页码:52 / 87
页数:36
相关论文
共 174 条
[1]   Signal-Dependent Noise Modeling and Model Parameter Estimation in Hyperspectral Images [J].
Acito, Nicola ;
Diani, Marco ;
Corsini, Giovanni .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (08) :2957-2971
[2]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[3]  
Akhtar N, 2015, PROC CVPR IEEE, P3631, DOI 10.1109/CVPR.2015.7298986
[4]   Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution [J].
Akhtar, Naveed ;
Shafait, Faisal ;
Mian, Ajmal .
COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 :63-78
[5]   Data Products, Quality and Validation of the DLR Earth Sensing Imaging Spectrometer (DESIS) [J].
Alonso, Kevin ;
Bachmann, Martin ;
Burch, Kara ;
Carmona, Emiliano ;
Cerra, Daniele ;
de los Reyes, Raquel ;
Dietrich, Daniele ;
Heiden, Uta ;
Hoelderlin, Andreas ;
Ickes, Jack ;
Knodt, Uwe ;
Krutz, David ;
Lester, Heath ;
Mueller, Rupert ;
Pagnutti, Mary ;
Reinartz, Peter ;
Richter, Rudolf ;
Ryan, Robert ;
Sebastian, Ilse ;
Tegler, Mirco .
SENSORS, 2019, 19 (20)
[6]   Patch Tensor-Based Sparse and Low-Rank Graph for HyperspectralImages Dimensionality Reduction [J].
An, Jinliang ;
Zhang, Xiangrong ;
Zhou, Huiyu ;
Feng, Jie ;
Jiao, Licheng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (07) :2513-2527
[7]   Tensor-Based Low-Rank Graph With Multimanifold Regularization for Dimensionality Reduction of Hyperspectral Images [J].
An, Jinliang ;
Zhang, Xiangrong ;
Zhou, Huiyu ;
Jiao, Licheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (08) :4731-4746
[8]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[9]   Hyperspectral Remote Sensing Data Analysis and Future Challenges [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Camps-Valls, Gustavo ;
Scheunders, Paul ;
Nasrabadi, Nasser M. ;
Chanussot, Jocelyn .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2013, 1 (02) :6-36
[10]   Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Dobigeon, Nicolas ;
Parente, Mario ;
Du, Qian ;
Gader, Paul ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (02) :354-379