An end-to-end deep convolutional neural network for image restoration of sparse aperture imaging system in geostationary orbit

被引:1
作者
Zhao, Wenxiu [1 ]
Zhang, Xiaofang [1 ]
Wang, Jing [1 ]
Gu, Yun [1 ]
机构
[1] Beijing Inst Technol, Sch Opt & Photon, Beijing, Peoples R China
来源
OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY IX | 2022年 / 12317卷
关键词
image restoration; sparse aperture imaging system; deep learning; U-net;
D O I
10.1117/12.2643825
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The development of large-aperture telescopes employing monolithic mirrors has been greatly limited by technical constraints and the difficulty of processing and manufacturing. The sparse aperture imaging system employing multiple small-sub apertures arranged and combined onto a co-phasing surface can achieve the equivalent resolution to the fully-filled aperture system, which brings new research ideas for astronomical observation and ground survey. However, the sparsity of apertures will result in blurred imaging. In this paper, we focus on the high-resolution imaging from the geostationary orbit and propose a restoration method for blurred images obtained by the sparse aperture system with a 12-sub-aperture annular-like structure. A SASDeblurNet, containing U-shaped structures and skip connections, is proposed to rapidly restore blurred images end-to-end. MAE, MSE, DSSIM, Charbonnier, and edge loss functions are attempted to train a small amount of data sets in anticipation of better imaging results. The simulation results show that the image restored by the proposed method improves the PSNR by an average of 11 dB and the SSIM of the restoration image improves from 0.77 to 0.94, achieving a high resolution comparable to that of a full-aperture optical system. Compared with traditional non-blind deconvolution algorithms, SASDeblurNet can effectively remove the effect of artifacts. Our work shows that the proposed method has good real-time performance, generalization ability, and noise immunity, which can provide the corresponding data support for on-orbit and real-time observation of sparse aperture imaging systems.
引用
收藏
页数:9
相关论文
共 23 条
[1]   NTIRE 2019 Challenge on Real Image Denoising: Methods and Results [J].
Abdelhamed, Abdelrahman ;
Timofte, Radu ;
Brown, Michael S. ;
Yu, Songhyun ;
Park, Bumjun ;
Jeong, Jechang ;
Jung, Seung-Won ;
Kim, Dong-Wook ;
Chung, Jae-Ryun ;
Liu, Jiaming ;
Wang, Yuzhi ;
Wu, Chi-Hao ;
Xu, Qin ;
Wang, Chuan ;
Cai, Shaofan ;
Ding, Yifan ;
Fan, Haoqiang ;
Wang, Jue ;
Zhang, Kai ;
Zuo, Wangmeng ;
Zhussip, Magauiya ;
Park, Dong Won ;
Soltanayev, Shakarim ;
Chun, Se Young ;
Xiong, Zhiwei ;
Chen, Chang ;
Haris, Muhammad ;
Akita, Kazutoshi ;
Yoshida, Tomoki ;
Shakhnarovich, Greg ;
Ukita, Norimichi ;
Zamir, Syed Waqas ;
Arora, Aditya ;
Khan, Salman ;
Khan, Fahad Shahbaz ;
Shao, Ling ;
Ko, Sung-Jea ;
Lim, Dong-Pan ;
Kim, Seung-Wook ;
Ji, Seo-Won ;
Lee, Sang-Won ;
Tang, Wenyi ;
Fan, Yuchen ;
Zhou, Yuqian ;
Liu, Ding ;
Huang, Thomas S. ;
Meng, Deyu ;
Zhang, Lei ;
Yong, Hongwei ;
Zhao, Yiyun .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :2197-2210
[2]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[3]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[4]   Comparison of reconstruction algorithms for images from sparse-aperture systems [J].
Fienup, JR ;
Griffith, D ;
Harrington, L ;
Kowalczyk, AM ;
Miller, JJ ;
Mooney, JA .
IMAGE RECONSTRUCTION FROM INCOMPLETE DATA II, 2002, 4792 :1-8
[5]   POINT ARRAYS HAVING COMPACT, NONREDUNDANT AUTOCORRELATIONS [J].
GOLAY, MJE .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1971, 61 (02) :272-&
[6]   Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact Removal [J].
Guan, Steven ;
Khan, Amir A. ;
Sikdar, Siddhartha ;
Chitnis, Parag V. .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (02) :568-576
[7]   Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network [J].
Hui, Mei ;
Wu, Yong ;
Li, Weiqian ;
Liu, Ming ;
Dong, Liquan ;
Kong, Lingqin ;
Zhao, Yuejin .
OPTICS EXPRESS, 2020, 28 (07) :9929-9943
[8]   Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks [J].
Lai, Wei-Sheng ;
Huang, Jia-Bin ;
Ahuja, Narendra ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (11) :2599-2613
[9]   Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining [J].
Li, Xia ;
Wu, Jianlong ;
Lin, Zhouchen ;
Liu, Hong ;
Zha, Hongbin .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :262-277
[10]   Novel array configuration and its optimization for sparse aperture imaging systems [J].
Liu, Li ;
Jiang, Yuesong ;
Wang, Haiyang ;
He, Yuntao .
OPTICAL ENGINEERING, 2011, 50 (05)