Polarimetric Imaging via Deep Learning: A Review

被引:47
作者
Li, Xiaobo [1 ]
Yan, Lei [2 ]
Qi, Pengfei [3 ]
Zhang, Liping [4 ]
Goudail, Francois [5 ]
Liu, Tiegen [6 ]
Zhai, Jingsheng [1 ]
Hu, Haofeng [1 ]
机构
[1] Tianjin Univ, Sch Marine Sci & Technol, Tianjin 300072, Peoples R China
[2] Peking Univ, Inst Remote Sensing & Geog Informat Syst, Spatial Informat Integrat & 3S Engn Applicat Beiji, Beijing 100871, Peoples R China
[3] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[4] Chinese Univ Hong Kong, Dept Imaging & Intervent Radiol, Hong Kong 999077, Peoples R China
[5] Univ Paris Saclay, Inst Opt, Lab Charles Fabry, CNRS,Grad Sch, F-91120 Palaiseau, France
[6] Tianjin Univ, Sch Precis Instrument & Optoelect Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
polarization; polarimetric imaging; synthetic aperture radar; remote sensing; deep learning; convolutional neural network; CONVOLUTIONAL NEURAL-NETWORK; IMPERVIOUS SURFACE ESTIMATION; POLARIZATION IMAGE; INTEGRATION TIME; TARGET DETECTION; MUELLER MATRIX; SAR IMAGES; INTENSITY MEASUREMENTS; SHIP DETECTION; UNSUPERVISED CLASSIFICATION;
D O I
10.3390/rs15061540
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Polarization can provide information largely uncorrelated with the spectrum and intensity. Therefore, polarimetric imaging (PI) techniques have significant advantages in many fields, e.g., ocean observation, remote sensing (RS), biomedical diagnosis, and autonomous vehicles. Recently, with the increasing amount of data and the rapid development of physical models, deep learning (DL) and its related technique have become an irreplaceable solution for solving various tasks and breaking the limitations of traditional methods. PI and DL have been combined successfully to provide brand-new solutions to many practical applications. This review briefly introduces PI and DL's most relevant concepts and models. It then shows how DL has been applied for PI tasks, including image restoration, object detection, image fusion, scene classification, and resolution improvement. The review covers the state-of-the-art works combining PI with DL algorithms and recommends some potential future research directions. We hope that the present work will be helpful for researchers in the fields of both optical imaging and RS, and that it will stimulate more ideas in this exciting research field.
引用
收藏
页数:42
相关论文
共 331 条
[1]   A Block-Matching and 3-D Filtering Algorithm for Gaussian Noise in DoFP Polarization Images [J].
Abubakar, Abubakar ;
Zhao, Xiaojin ;
Li, Shiting ;
Takruri, Maen ;
Bastaki, Eesa ;
Bermak, Amine .
IEEE SENSORS JOURNAL, 2018, 18 (18) :7429-7435
[2]   Residual interpolation for division of focal plane polarization image sensors [J].
Ahmed, Ashfaq ;
Zhao, Xiaojin ;
Gruev, Viktor ;
Zhang, Junchao ;
Bermak, Amine .
OPTICS EXPRESS, 2017, 25 (09) :10651-10662
[3]   Urban landscape extraction and analysis based on optical and microwave ALOS satellite data [J].
Aimaiti, Yusupujiang ;
Kasimu, Alimujiang ;
Jing, Guo .
EARTH SCIENCE INFORMATICS, 2016, 9 (04) :425-435
[4]   Superresolution Full-polarimetric Imaging for Radio Interferometry with Sparse Modeling [J].
Akiyama, Kazunori ;
Ikeda, Shiro ;
Pleau, Mollie ;
Fish, Vincent L. ;
Tazaki, Fumie ;
Kuramochi, Kazuki ;
Broderick, Avery E. ;
Dexter, Jason ;
Moscibrodzka, Monika ;
Gowanlock, Michael ;
Honma, Mareki ;
Doeleman, Sheperd S. .
ASTRONOMICAL JOURNAL, 2017, 153 (04)
[5]   Joint contrast optimization and object segmentation in active polarimetric images [J].
Anna, Guillaume ;
Bertaux, Nicolas ;
Galland, Frederic ;
Goudail, Francois ;
Dolfi, Daniel .
OPTICS LETTERS, 2012, 37 (16) :3321-3323
[6]   Adaptive Model-Based Decomposition of Polarimetric SAR Covariance Matrices [J].
Arii, Motofumi ;
van Zyl, Jakob J. ;
Kim, Yunjin .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (03) :1104-1113
[7]   Estimation of Degree of Polarization in Low Light Using Truncated Poisson Distribution [J].
Avinoa, Marcos ;
Shen, Xin ;
Bosch, Salvador ;
Javidi, Bahram ;
Carnicer, Artur .
IEEE PHOTONICS JOURNAL, 2022, 14 (03)
[8]  
Ba YH, 2019, Arxiv, DOI [arXiv:1910.00201, DOI 10.48550/ARXIV.1910.00201]
[9]   Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community [J].
Ball, John E. ;
Anderson, Derek T. ;
Chan, Chee Seng .
JOURNAL OF APPLIED REMOTE SENSING, 2017, 11
[10]   On the use of deep learning for computational imaging [J].
Barbastathis, George ;
Ozcan, Aydogan ;
Situ, Guohai .
OPTICA, 2019, 6 (08) :921-943