Boosting Restoration of Turbulence-Degraded Images With State Space Conditional Diffusion

被引:0
作者
Wu, Yubo [1 ]
Cheng, Kuanhong [1 ]
Chai, Tingting [2 ]
Lyu, Gengyu [3 ]
Zhao, Shuping [4 ]
Jia, Wei [5 ]
机构
[1] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Peoples R China
[2] Harbin Inst Technol, Fac Comp, Weihai 264209, Peoples R China
[3] Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
[4] Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou 510006, Peoples R China
[5] Hefei Univ Technol, Sch Comp & Informat, Hefei 230009, Peoples R China
基金
中国国家自然科学基金;
关键词
Image restoration; Frequency-domain analysis; Mathematical models; Degradation; Stochastic processes; Transformers; Noise reduction; Computer architecture; Computational modeling; Training; turbulence distortion; deep learning; DDPM; SSM; ATMOSPHERIC-TURBULENCE;
D O I
10.1109/TSP.2025.3580723
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recovering fine details from turbulence-distorted images is highly challenging due to the complex, spatially varying, and stochastic nature of the distortion process. Conventional multi-frame methods rely on extracting and averaging clear regions from pre-aligned frames, but their effectiveness is limited due to the rarity of "lucky regions". In contrast, learning based methods have shown superior performance across various vision tasks. However, existing deep learning approaches still face key limitations: (1) they struggle to efficiently model the global context required for correcting pixel dispersion caused by spatially varying Point Spread Functions (PSFs); (2) they often overlook the physical formation of turbulence, particularly the spatial-frequency relationship between phase distortions and PSFs; and (3) they rely on deterministic architectures that fail to capture the inherent uncertainty in turbulence, leading to visually implausible outputs. To address these issues, we propose the Two-Stage Turbulence Removal Network (TSTRNet). The first stage uses a UNet-based generator built on the State Space Model to perform efficient, coarse global restoration. The second stage refines the output through a Denoising Diffusion Probabilistic Model, introducing stochasticity and edge-guided conditioning for detail enhancement and realism. Both stages incorporate frequency-domain processing to align with the physical characteristics of turbulence. Experimental results on multiple benchmark datasets demonstrate that TSTRNet achieves superior restoration performance compared to state-of-the-art methods, with strong generalization from synthetic to real-world scenarios.
引用
收藏
页码:2631 / 2645
页数:15
相关论文
共 62 条
[1]  
Al-Najjar Y., 2012, Int. J. Sci. Eng. Res., V3, P1
[2]  
Anantrasirichai N, 2018, IEEE IMAGE PROC, P2895, DOI 10.1109/ICIP.2018.8451755
[3]   Atmospheric Turbulence Mitigation Using Complex Wavelet-Based Fusion [J].
Anantrasirichai, Nantheera ;
Achim, Alin ;
Kingsbury, Nick G. ;
Bull, David R. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (06) :2398-2408
[4]  
Bharathi N., 2023, Scene classification
[5]  
Cao Hu, 2023, Computer Vision - ECCV 2022 Workshops: Proceedings. Lecture Notes in Computer Science (13803), P205, DOI 10.1007/978-3-031-25066-8_9
[6]   Local Curvature Optimization for Self-Supervised Image Restoration [J].
Cheng, Kuanhong ;
Prasad, Shitala ;
Chai, Tingting ;
Xue, Wangwang ;
Zhao, Dong .
IEEE SIGNAL PROCESSING LETTERS, 2024, 31 :1294-1298
[7]   Scattering and Gathering for Spatially Varying Blurs [J].
Chimitt, Nicholas ;
Zhang, Xingguang ;
Chi, Yiheng ;
Chan, Stanley H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2024, 72 :1507-1517
[8]   Real-Time Dense Field Phase-to-Space Simulation of Imaging Through Atmospheric Turbulence [J].
Chimitt, Nicholas ;
Zhang, Xingguang ;
Mao, Zhiyuan ;
Chan, Stanley H. .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 :1159-1169
[9]   SUNet: Swin Transformer UNet for Image Denoising [J].
Fan, Chi-Mao ;
Liu, Tsung-Jung ;
Liu, Kuan-Hsien .
2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, :2333-2337
[10]   Open Turbulent Image Set (OTIS) [J].
Gilles, Jerome ;
Ferrante, Nicholas B. .
PATTERN RECOGNITION LETTERS, 2017, 86 :38-41