A lightweight iterative error reconstruction network for infrared image super-resolution in smart grid

被引:14
作者
Chen, Lihui [1 ]
Tang, Rui [1 ]
Anisetti, Marco [2 ]
Yang, Xiaomin [1 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610064, Sichuan, Peoples R China
[2] Univ Milan, Dipartimento Informat DI, Via Celoria 18, I-20133 Milan, MI, Italy
基金
中国国家自然科学基金;
关键词
Convolutional neural networks; Deep learning; Smart grid; Infrared image super-resolution; ENHANCEMENT; DICTIONARY;
D O I
10.1016/j.scs.2020.102520
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Thermal infrared (IR) images are widely used in smart grids for numerous applications. These applications prefer high-resolution (HR) IR images since HR IR images benefit the performance. However, HR IR imaging devices are extremely expensive. To save the cost of upgrading imaging devices, an iterative error reconstruction network (IERN) is proposed to improve the resolution of IR images. We first achieve efficient dense connections based on linearly compressive skip links. Slightly sacrificing the performance, the efficient dense connections can mark-edly reduce the parameters and computations of the vanilla dense connections. Then, an iterative error recon-struction mechanism is proposed to boost the performance, which enables IERN to restore many more textures and edges. Specifically, an initial SR image, high-level features, and up-sampled features are obtained firstly. Secondly, a SR error image is acquired by reconstructing the errors between the initial high-level features and the back-projected features from the up-sampled features. Thirdly, a new SR image is obtained by adding the SR error image to the initial SR image. Iterating the above process, the final SR image is achieved when the number of iterations reaches to the iteration threshold. Experimental results reveal the superiority of the proposed method over state-of-the-art methods.
引用
收藏
页数:13
相关论文
共 63 条
[51]   Quantized Convolutional Neural Networks for Mobile Devices [J].
Wu, Jiaxiang ;
Leng, Cong ;
Wang, Yuhang ;
Hu, Qinghao ;
Cheng, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4820-4828
[52]   Image Super-Resolution Via Sparse Representation [J].
Yang, Jianchao ;
Wright, John ;
Huang, Thomas S. ;
Ma, Yi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (11) :2861-2873
[53]   LCSCNet: Linear Compressing-Based Skip-Connecting Network for Image Super-Resolution [J].
Yang, Wenming ;
Zhang, Xuechen ;
Tian, Yapeng ;
Wang, Wei ;
Xue, Jing-Hao ;
Liao, Qingmin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :1450-1464
[54]   Multiple dictionary pairs learning and sparse representation-based infrared image super-resolution with improved fuzzy clustering [J].
Yang, Xiaomin ;
Wu, Wei ;
Liu, Kai ;
Chen, Weilong ;
Zhou, Zhili .
SOFT COMPUTING, 2018, 22 (05) :1385-1398
[55]   Fast multisensor infrared image super-resolution scheme with multiple regression models [J].
Yang, Xiaomin ;
Wu, Wei ;
Liu, Kai ;
Zhou, Kai ;
Yana, Binyu .
JOURNAL OF SYSTEMS ARCHITECTURE, 2016, 64 :11-25
[56]  
Yosinski J, 2014, ADV NEUR IN, V27
[57]   Learning a Single Convolutional Super-Resolution Network for Multiple Degradations [J].
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3262-3271
[58]   ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices [J].
Zhang, Xiangyu ;
Zhou, Xinyu ;
Lin, Mengxiao ;
Sun, Ran .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6848-6856
[59]   Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning [J].
Zhang, Xudong ;
Li, Chunlai ;
Meng, Qingpeng ;
Liu, Shijie ;
Zhang, Yue ;
Wang, Jianyu .
SENSORS, 2018, 18 (08)
[60]   Residual Dense Network for Image Super-Resolution [J].
Zhang, Yulun ;
Tian, Yapeng ;
Kong, Yu ;
Zhong, Bineng ;
Fu, Yun .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2472-2481