Towards a Novel Generative Adversarial Network-Based Framework for Remote Sensing Image Demosaicking

被引:2
作者
Guo, Yuxuan [1 ,2 ]
Zhang, Xuemin [1 ,2 ,3 ]
Jin, Guang [1 ,2 ,3 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430072, Peoples R China
[2] Wuhan Univ, Inst Aerosp Sci & Technol, Wuhan 430072, Peoples R China
[3] Hubei Luojia Lab, Wuhan 430070, Peoples R China
关键词
remote sensing image demosaicking; generative adversarial networks; attention mechanism; COLOR; SUPERRESOLUTION; INTERPOLATION;
D O I
10.3390/rs16132283
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
During satellite remote sensing imaging, the use of Bayer mode sensors holds significant importance in saving airborne computing resources and reducing the burden of satellite transmission systems. The demosaicing techniques play a key role in this process. The integration of Generative Adversarial Networks (GANs) has garnered significant interest in the realm of image demosaicking, owing to their ability to generate intricate details. However, when demosaicing mosaic images in remote sensing techniques, GANs, although capable of generating rich details, often introduce unpleasant artifacts while generating content. To address this challenge and differentiate between undesirable artifacts and realistic details, we have devised a novel framework based on a Progressive Discrimination Strategy within a Generative Adversarial Network architecture for image demosaicking. Our approach incorporates an artifact-weighted Location Map refinement technique to guide the optimization process towards generating authentic details in a stable and precise manner. Furthermore, our framework integrates a global attention mechanism to boost the interaction of spatial-channel information across different dimensions, thereby enhancing the performance of the generator network. Moreover, we conduct a comparative analysis of various prevalent attention mechanisms in the context of remote sensing image demosaicking. The experimental findings unequivocally demonstrate that our proposed methodology not only achieves superior reconstruction accuracy on the dataset but also enhances the perceptual quality of the generated images. By effectively mitigating artifacts and emphasizing the generation of true details, our approach represents a significant advancement in the field of remote sensing image demosaicking, promising enhanced visual fidelity and realism in reconstructed images.
引用
收藏
页数:18
相关论文
共 66 条
[1]  
Adams J. E. Jr., 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269), P488, DOI 10.1109/ICIP.1998.723540
[2]  
ADAMS JE, 1995, P SOC PHOTO-OPT INS, V2416, P144
[3]  
[Anonymous], Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal
[4]   Self-Similarity Driven Color Demosaicking [J].
Buades, Antoni ;
Coll, Bartomeu ;
Morel, Jean-Michel ;
Sbert, Catalina .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (06) :1192-1202
[5]   A Two-Stage Convolutional Neural Network for Joint Demosaicking and Super-Resolution [J].
Chang, Kan ;
Li, Hengxin ;
Tan, Yufei ;
Ding, Pak Lun Kevin ;
Li, Baoxin .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) :4238-4254
[6]   Effective use of spatial and spectral correlations for color filter array demosaicking [J].
Chang, LL ;
Tan, YP .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2004, 50 (01) :355-365
[7]   Multidirectional Weighted Interpolation and Refinement Method for Bayer Pattern CFA Demosaicking [J].
Chen, Xiangdong ;
He, Liwen ;
Jeon, Gwanggil ;
Jeong, Jechang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2015, 25 (08) :1271-1282
[8]   Joint Chroma Subsampling and Distortion-Minimization-Based Luma Modification for RGB Color Images With Application [J].
Chung, Kuo-Liang ;
Hsu, Tsu-Chun ;
Huang, Chi-Chao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (10) :4626-4638
[9]  
Dong WS, 2018, Arxiv, DOI arXiv:1802.04723
[10]   The PASCAL Visual Object Classes Challenge: A Retrospective [J].
Everingham, Mark ;
Eslami, S. M. Ali ;
Van Gool, Luc ;
Williams, Christopher K. I. ;
Winn, John ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 111 (01) :98-136