A lightweight iterative error reconstruction network for infrared image super-resolution in smart grid

被引:14
作者
Chen, Lihui [1 ]
Tang, Rui [1 ]
Anisetti, Marco [2 ]
Yang, Xiaomin [1 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610064, Sichuan, Peoples R China
[2] Univ Milan, Dipartimento Informat DI, Via Celoria 18, I-20133 Milan, MI, Italy
基金
中国国家自然科学基金;
关键词
Convolutional neural networks; Deep learning; Smart grid; Infrared image super-resolution; ENHANCEMENT; DICTIONARY;
D O I
10.1016/j.scs.2020.102520
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Thermal infrared (IR) images are widely used in smart grids for numerous applications. These applications prefer high-resolution (HR) IR images since HR IR images benefit the performance. However, HR IR imaging devices are extremely expensive. To save the cost of upgrading imaging devices, an iterative error reconstruction network (IERN) is proposed to improve the resolution of IR images. We first achieve efficient dense connections based on linearly compressive skip links. Slightly sacrificing the performance, the efficient dense connections can mark-edly reduce the parameters and computations of the vanilla dense connections. Then, an iterative error recon-struction mechanism is proposed to boost the performance, which enables IERN to restore many more textures and edges. Specifically, an initial SR image, high-level features, and up-sampled features are obtained firstly. Secondly, a SR error image is acquired by reconstructing the errors between the initial high-level features and the back-projected features from the up-sampled features. Thirdly, a new SR image is obtained by adding the SR error image to the initial SR image. Iterating the above process, the final SR image is achieved when the number of iterations reaches to the iteration threshold. Experimental results reveal the superiority of the proposed method over state-of-the-art methods.
引用
收藏
页数:13
相关论文
共 63 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]  
[Anonymous], 2014, ARXIV NEURAL EVOLUTI
[4]   A trusted medical image super-resolution method based on feedback adaptive weighted dense network [J].
Chen, Lihui ;
Yang, Xiaomin ;
Jeon, Gwanggil ;
Anisetti, Marco ;
Liu, Kai .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2020, 106
[5]  
Choi Y, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P223, DOI 10.1109/IROS.2016.7759059
[6]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[7]  
Chu X., 2019, ARXIV190101074
[8]   HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation [J].
Dolz, Jose ;
Gopinath, Karthik ;
Yuan, Jing ;
Lombaert, Herve ;
Desrosiers, Christian ;
Ben Ayed, Ismail .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (05) :1116-1126
[9]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[10]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307