GradDT: Gradient-Guided Despeckling Transformer for Industrial Imaging Sensors

被引:10
作者
Lu, Yuxu [1 ]
Guo, Yu [1 ]
Liu, Ryan Wen [1 ]
Chui, Kwok Tai [2 ]
Gupta, Brij B. [3 ,4 ]
机构
[1] Wuhan Univ Technol, Sch Nav, Wuhan 430063, Peoples R China
[2] Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China
[3] Asia Univ, Dept Comp Sci & Informat Engn, Taichung 413, Taiwan
[4] Staffordshire Univ, Stoke on Trent ST4 2DE, England
基金
中国国家自然科学基金;
关键词
Despeckling; gradient model; industrial imaging sensors; logarithmic domain; machine learning; NORM MINIMIZATION; CLASSIFICATION;
D O I
10.1109/TII.2022.3199274
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The speckle noise is a granular disturbance that often brings negative side effects on the detection and recognition of targets of interest in industrial imaging sensors. From the statistical point of view, this type of noise can be modeled as a multiplicative formula. The nonlinear multiplicative property makes despeckling more intractable with respect to noise reduction and details preservation. To blindly remove the undesirable speckle noise, we combine the gradient model and machine learning technology for despeckling. In particular, we first introduce the logarithmic transformation to transform the multiplicative speckle noise into an additive version. A gradient-guided despeckling transformer (termed GradDT) is then proposed to blindly reduce the additive noise in the transformed noisy images. To be specific, the proposed method mainly includes two modules, i.e., the spatial feature extraction module (SFEM) and the efficient transformer module (ETM). The SFEM can extract the spatial feature of speckle noise and the gradient maps corresponding to the noise-free image. The ETM module can calculate the spatial domain's cross-channel cross-covariance and produce global attention maps to reconstruct the sharp image. The proposed GradDT thus can effectively distinguish the speckle noise and vital image features (e.g., edge and texture) to balance the degree of noise suppression and details preservation. Extensive experiments have been implemented on both synthetic and realistic degraded images. Compared with several state-of-the-art speckle noise reduction methods, our GradDT could generate superior imaging performance in terms of both quantitative evaluation and visual quality.
引用
收藏
页码:2238 / 2248
页数:11
相关论文
共 46 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   IoT transaction processing through cooperative concurrency control on fog-cloud computing environment [J].
Al-Qerem, Ahmad ;
Alauthman, Mohammad ;
Almomani, Ammar ;
Gupta, B. B. .
SOFT COMPUTING, 2020, 24 (08) :5695-5711
[3]   Impact of digital fingerprint image quality on the fingerprint recognition accuracy [J].
Alsmirat, Mohammad A. ;
Al-Alem, Fatimah ;
Al-Ayyoub, Mahmoud ;
Jararweh, Yaser ;
Gupta, Brij .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (03) :3649-3688
[4]   A variational approach to removing multiplicative noise [J].
Aubert, Gilles ;
Aujol, Jean-Francois .
SIAM JOURNAL ON APPLIED MATHEMATICS, 2008, 68 (04) :925-946
[5]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[6]  
Chierchia G, 2017, INT GEOSCI REMOTE SE, P5438, DOI 10.1109/IGARSS.2017.8128234
[7]   Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights [J].
Deledalle, Charles-Alban ;
Denis, Loic ;
Tupin, Florence .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (12) :2661-2672
[8]   DE-NOISING BY SOFT-THRESHOLDING [J].
DONOHO, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (03) :613-627
[9]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[10]   Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms [J].
Elgendy, Ibrahim A. ;
Zhang, Wei-Zhe ;
He, Hui ;
Gupta, Brij B. ;
Abd El-Latif, Ahmed A. .
WIRELESS NETWORKS, 2021, 27 (03) :2023-2038