An end-to-end deep convolutional neural network for image restoration of sparse aperture imaging system in geostationary orbit

被引:1
作者
Zhao, Wenxiu [1 ]
Zhang, Xiaofang [1 ]
Wang, Jing [1 ]
Gu, Yun [1 ]
机构
[1] Beijing Inst Technol, Sch Opt & Photon, Beijing, Peoples R China
来源
OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY IX | 2022年 / 12317卷
关键词
image restoration; sparse aperture imaging system; deep learning; U-net;
D O I
10.1117/12.2643825
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The development of large-aperture telescopes employing monolithic mirrors has been greatly limited by technical constraints and the difficulty of processing and manufacturing. The sparse aperture imaging system employing multiple small-sub apertures arranged and combined onto a co-phasing surface can achieve the equivalent resolution to the fully-filled aperture system, which brings new research ideas for astronomical observation and ground survey. However, the sparsity of apertures will result in blurred imaging. In this paper, we focus on the high-resolution imaging from the geostationary orbit and propose a restoration method for blurred images obtained by the sparse aperture system with a 12-sub-aperture annular-like structure. A SASDeblurNet, containing U-shaped structures and skip connections, is proposed to rapidly restore blurred images end-to-end. MAE, MSE, DSSIM, Charbonnier, and edge loss functions are attempted to train a small amount of data sets in anticipation of better imaging results. The simulation results show that the image restored by the proposed method improves the PSNR by an average of 11 dB and the SSIM of the restoration image improves from 0.77 to 0.94, achieving a high resolution comparable to that of a full-aperture optical system. Compared with traditional non-blind deconvolution algorithms, SASDeblurNet can effectively remove the effect of artifacts. Our work shows that the proposed method has good real-time performance, generalization ability, and noise immunity, which can provide the corresponding data support for on-orbit and real-time observation of sparse aperture imaging systems.
引用
收藏
页数:9
相关论文
共 23 条
[11]   Optical sparse aperture imaging [J].
Miller, Nicholas J. ;
Dierking, Matthew P. ;
Duncan, Bradley D. .
APPLIED OPTICS, 2007, 46 (23) :5933-5943
[12]   Progressive Image Deraining Networks: A Better and Simpler Baseline [J].
Ren, Dongwei ;
Zuo, Wangmeng ;
Hu, Qinghua ;
Zhu, Pengfei ;
Meng, Deyu .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3932-3941
[13]  
Seif G, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), P1468, DOI 10.1109/ICASSP.2018.8461664
[14]   Improving mid-frequency contrast in sparse aperture optical imaging systems based upon the Golay-9 array [J].
Stokes, Andrew J. ;
Duncan, Bradley D. ;
Dierking, Mathew P. .
OPTICS EXPRESS, 2010, 18 (05) :4417-4427
[15]   RestoreNet-Plus: Image restoration via deep learning in optical synthetic aperture imaging system [J].
Tang, Ju ;
Wu, Ji ;
Wang, Kaiqiang ;
Ren, Zhenbo ;
Wu, Xiaoyan ;
Hu, Liusen ;
Di, Jianglei ;
Liu, Guodong ;
Zhao, Jianlin .
OPTICS AND LASERS IN ENGINEERING, 2021, 146 (146)
[16]   RestoreNet: a deep learning framework for image restoration in optical synthetic aperture imaging system [J].
Tang, Ju ;
Wang, Kaiqiang ;
Ren, Zhenbo ;
Zhang, Wei ;
Wu, Xiaoyan ;
Di, Jianglei ;
Liu, Guodong ;
Zhao, Jianlin .
OPTICS AND LASERS IN ENGINEERING, 2021, 139
[17]  
Wang J, 2020, SPIE, V11570, P197
[18]   Image quality assessment: From error visibility to structural similarity [J].
Wang, Z ;
Bovik, AC ;
Sheikh, HR ;
Simoncelli, EP .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) :600-612
[19]  
Werth M, 2019, AEROSP CONF PROC
[20]  
Yang Yi, 2010, SIGSPATIAL GIS, P270, DOI DOI 10.1145/1869790.1869829