Binarized Neural Network for Single Image Super Resolution

被引:62
作者
Xin, Jingwei [1 ]
Wang, Nannan [2 ]
Jiang, Xinrui [1 ,2 ]
Li, Jie
Huang, Heng [3 ]
Gao, Xinbo [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Sch Telecommun Engn, Xian 710071, Peoples R China
[3] Univ Pittsburgh, Sch Elect & Comp Engn, Pittsburgh, PA 15261 USA
来源
COMPUTER VISION - ECCV 2020, PT IV | 2020年 / 12349卷
基金
中国国家自然科学基金;
关键词
Single image super-resolution; Model quantization; Binary neural network; Bit-accumulation mechanism; SUPERRESOLUTION;
D O I
10.1007/978-3-030-58548-8_6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Lighter model and faster inference are the focus of current single image super-resolution (SISR) research. However, existing methods are still hard to be applied in real-world applications due to the heavy computation requirement. Model quantization is an effective way to significantly reduce model size and computation time. In this work, we investigate the binary neural network-based SISR problem and propose a novel model binarization method. Specially, we design a bit-accumulation mechanism (BAM) to approximate the full-precision convolution with a value accumulation scheme, which can gradually refine the precision of quantization along the direction of model inference. In addition, we further construct an efficient model structure based on the BAM for lower computational complexity and parameters. Extensive experiments show the proposed model outperforms the state-of-the-art binarization methods by large margins on 4 benchmark datasets, specially by average more than 0.7 dB in terms of Peak Signal-to-Noise Ratio on Set5 dataset.
引用
收藏
页码:91 / 107
页数:17
相关论文
共 34 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   A Deep Convolutional Neural Network with Selection Units for Super-Resolution [J].
Choi, Jae-Seok ;
Kim, Munchurl .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1150-1156
[4]  
Courbariaux M, 2016, Arxiv, DOI arXiv:1602.02830
[5]  
Courbariaux M, 2015, ADV NEUR IN, V28
[6]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[7]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[8]   ODE-inspired Network Design for Single Image Super-Resolution [J].
He, Xiangyu ;
Mo, Zitao ;
Wang, Peisong ;
Liu, Yang ;
Yang, Mingyuan ;
Cheng, Jian .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1732-1741
[9]  
Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156
[10]  
Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.182, 10.1109/CVPR.2016.181]