Ultralight-Weight Three-Prior Convolutional Neural Network for Single Image Super Resolution

被引:8
作者
Esmaeilzehi A. [1 ]
Ahmad M.O. [1 ]
Swamy M.N.S. [1 ]
机构
[1] Concordia University, Department of Electrical and Computer Engineering, Montreal, H3G 1M8, QC
来源
IEEE Transactions on Artificial Intelligence | 2023年 / 4卷 / 06期
基金
加拿大自然科学与工程研究理事会;
关键词
Convolutional neural networks; deep learning; image super resolution; sparse representation;
D O I
10.1109/TAI.2022.3224417
中图分类号
学科分类号
摘要
The task of image super resolution is crucial in many applications, such as computer vision and medical imaging. Conventionally, the task of image super resolution was carried out by formulating it as a constrained optimization problem and then solving it using suitable numerical techniques. However, after the emergence of deep neural networks, the focus of the researchers in this area has been almost entirely on designing deep convolutional neural network architectures that indeed have provided remarkable performance for the task of image super resolution. Even though unified methods of combining the two approaches has a greater potential of providing a superior performance for the task of image super resolution, with the exception of very few works, not much attention has been paid to develop such a unified method for this task. In this article, we propose a three-prior formulation of the optimization problem for image super resolution and develop an ultralight-weight convolutional neural network for its solution. The effectiveness of the proposed formulation of the optimization problem and ultralight-weight convolution neural network architecture for its solution is demonstrated through extensive experimentations of the proposed scheme on benchmark datasets and comparisons of the results with that of the other state-of-the-art ultralight-weight image super resolution networks. © 2020 IEEE.
引用
收藏
页码:1724 / 1738
页数:14
相关论文
共 54 条
  • [1] Park S.C., Park M.K., Kang M.G., Super-resolution image reconstruction: A technical overview, IEEE Signal Process. Mag., 20, 3, pp. 21-36, (2003)
  • [2] Wang Z., Chen J., Hoi S.C.H., Deep learning for image super resolution: A survey, IEEE Trans. Pattern Anal. Mach. Intell., 43, 10, pp. 3365-3387, (2021)
  • [3] Li Y., Zhang T., Chen C.L.P., Enhanced broad siamese network for facial emotion recognition in human-robot interaction, IEEE Trans. Artif. Intell., 2, 5, pp. 413-423, (2021)
  • [4] Li X., Jiang Y., Liu C., Liu S., Luo H., Yin S., Playing against deep-neural-network-based object detectors: A novel bidirectional adversarial attack approach, IEEE Trans. Artif. Intell., 3, 1, pp. 20-28, (2022)
  • [5] Zhang C., Et al., Character-level street view text spotting based on deep multi-segmentation network for smarter autonomous driving, IEEE Trans. Artif. Intell., 3, 2, pp. 297-308, (2022)
  • [6] Irani M., Peleg S., Improving resolution by image registration, CVGIP: Graphical Models Image Process., 53, 3, pp. 231-239, (1991)
  • [7] Dong C., Loy C.C., He K., Tang X., Image super-resolution using deep convolutional networks, IEEE Trans. Pattern Anal. Mach. Intell., 38, 2, pp. 295-307, (2016)
  • [8] Liu D., Wang Z., Wen B., Yang J., Han W., Huang T., Robust single image super-resolution via deep networks with sparse prior, IEEE Trans. Image Process., 38, 2, pp. 295-307, (2016)
  • [9] Dong C., Loy C.C., Tang X., Accelerating the super-resolution convolutional neural network, Proc. IEEE Eur. Conf. Comput. Vis., pp. 391-407, (2016)
  • [10] Lee W., Lee J., Kim D., Ham B., Learning with privileged information for efficient image super-resolution, Proc. IEEE Eur. Conf. Comput. Vis., pp. 465-482, (2020)