TCCL-DenseFuse: Infrared and Water Vapor Satellite Image Fusion Model Using Deep Learning

被引:2
作者
Zhang, Chang-Jiang [1 ]
Guo, Jia-Xu [2 ]
Ma, Lei-Ming [3 ]
Lu, Xiao-Qin [4 ]
Liu, Wen-Cai [2 ]
机构
[1] Taizhou Univ, Sch Elect & Informat Engn, Sch Big Data Sci, Taizhou 318000, Peoples R China
[2] Zhejiang Normal Univ, Coll Phys & Elect Informat Engn, Jinhua 321004, Peoples R China
[3] Shanghai Cent Meteorol Observ, Shanghai 200030, Peoples R China
[4] China Meteorol Adm, Shanghai Typhoon Inst, Shanghai 200030, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; infrared image; satellite image fusion; tropical cyclone (TC) center positioning; water vapor image; TROPICAL CYCLONE; NETWORK;
D O I
10.1109/JSTARS.2023.3277842
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This article proposes an infrared and water vapor channel satellite image fusion model (TCCL-DenseFuse) based on DenseNet. The infrared channel satellite image reflects the ground and cloud top infrared radiation or the distribution of temperature, and the water vapor channel satellite image reflects the spatial distribution of water vapor in the upper atmosphere. Studies have shown that infrared brightness temperature gradient and water vapor transport are closely related to tropical cyclone (TC) generation and evolution. In order to facilitate the fusion image obtained by the proposed fusion model to have a positive effect on TC monitoring and warning, the brightness temperature gradient and multiscale structural similarity in the satellite image are used to construct loss function of the proposed TCCL-DenseFuse model. The quality of the fused images is evaluated by seven objective quantitative indicators. In order to further verify the real application value of the proposed TCCL-DenseFuse model, fused images are also used to TC center location. Experimental results show that the proposed TCCL-DenseFuse fused satellite image not only contains rich information from both infrared and water vapor channels but also improves the accuracy of TC center positioning. The comprehensive performance of the proposed fusion model has certain advantages compared with similar fusion methods and can provide a reference for typhoon prevention and disaster mitigation.
引用
收藏
页码:4778 / 4800
页数:23
相关论文
共 32 条
[1]  
[成飞飞 Cheng Feifei], 2021, [测绘学报, Acta Geodetica et Cartographica Sinica], V50, P1380
[2]   Research on satellite remote sensing image fusion algorithm based on compression perception theory [J].
Chi, Zhifeng .
JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2021, 21 (02) :341-356
[3]  
Daza R. J. M., 2014, PROC 9 IBERIAN C INF, P1, DOI [10.1109/CISTI.2014.6877022, DOI 10.1109/CISTI.2014.6877022]
[4]  
Eckhorn R., 1989, CAN J MICROBIOL, V46, P759
[5]   SATELLITE IMAGE FUSION USING AN ITERATIVE IHS-BASED APPROACH [J].
Ghadjati, Mohamed ;
Benazza-Benyahia, Amel ;
Moussaoui, Abdelkrim .
2020 MEDITERRANEAN AND MIDDLE-EAST GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (M2GARSS), 2020, :133-136
[6]   A non-reference image fusion metric based on mutual information of image features [J].
Haghighat, Mohammad Bagher Akbari ;
Aghagolzadeh, Ali ;
Seyedarabi, Hadi .
COMPUTERS & ELECTRICAL ENGINEERING, 2011, 37 (05) :744-756
[7]   Objective Detection of Center of Tropical Cyclone in Remotely Sensed Infrared Images [J].
Jaiswal, Neeru ;
Kishtawal, C. M. .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2013, 6 (02) :1031-1035
[8]   SEDRFuse: A Symmetric Encoder-Decoder With Residual Block Network for Infrared and Visible Image Fusion [J].
Jian, Lihua ;
Yang, Xiaomin ;
Liu, Zheng ;
Jeon, Gwanggil ;
Gao, Mingliang ;
Chisholm, David .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[9]   Remote sensing image fusion method in CIELab color space using nonsubsampled shearlet transform and pulse coupled neural networks [J].
Jin, Xin ;
Zhou, Dongming ;
Yao, Shaowen ;
Nie, Rencan ;
Yu, Chuanbo ;
Ding, Tingting .
JOURNAL OF APPLIED REMOTE SENSING, 2016, 10
[10]   Unsupervised Deep Image Fusion With Structure Tensor Representations [J].
Jung, Hyungjoo ;
Kim, Youngjung ;
Jang, Hyunsung ;
Ha, Namkoo ;
Sohn, Kwanghoon .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3845-3858