A Heterogeneous Group CNN for Image Super-Resolution

被引:53
作者
Tian, Chunwei [1 ,2 ]
Zhang, Yanning [3 ]
Zuo, Wangmeng [4 ]
Lin, Chia-Wen [5 ,6 ]
Zhang, David [7 ,8 ]
Yuan, Yixuan [9 ]
机构
[1] Northwestern Polytech Univ, Sch Software, Xian 710129, Shaanxi, Peoples R China
[2] Natl Engn Lab Integrated Aerosp Ground Ocean Big, Xian 710129, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big, Xian 710129, Shaanxi, Peoples R China
[4] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
[5] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
[6] Natl Tsing Hua Univ, Inst Commun Engn, Hsinchu 30013, Taiwan
[7] Chinese Univ Hong Kong Shenzhen, Sch Data Sci, Shenzhen 518172, Guangdong, Peoples R China
[8] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen 518172, Peoples R China
[9] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Convolution; Training; Computer architecture; Superresolution; Network architecture; Convolutional neural networks; Feature extraction; Heterogeneous group convolutional architecture; image super-resolution (SR); multilevel enhancement mechanism; symmetric architecture; ACCURATE; NETWORK;
D O I
10.1109/TNNLS.2022.3210433
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNNs) have obtained remarkable performance via deep architectures. However, these CNNs often achieve poor robustness for image super-resolution (SR) under complex scenes. In this article, we present a heterogeneous group SR CNN (HGSRCNN) via leveraging structure information of different types to obtain a high-quality image. Specifically, each heterogeneous group block (HGB) of HGSRCNN uses a heterogeneous architecture containing a symmetric group convolutional block and a complementary convolutional block in a parallel way to enhance the internal and external relations of different channels for facilitating richer low-frequency structure information of different types. To prevent the appearance of obtained redundant features, a refinement block (RB) with signal enhancements in a serial way is designed to filter useless information. To prevent the loss of original information, a multilevel enhancement mechanism guides a CNN to achieve a symmetric architecture for promoting expressive ability of HGSRCNN. Besides, a parallel upsampling mechanism is developed to train a blind SR model. Extensive experiments illustrate that the proposed HGSRCNN has obtained excellent SR performance in terms of both quantitative and qualitative analysis. Codes can be accessed at https://github.com/hellloxiaotian/HGSRCNN.
引用
收藏
页码:6507 / 6519
页数:13
相关论文
共 63 条
  • [1] NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
    Agustsson, Eirikur
    Timofte, Radu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1122 - 1131
  • [2] Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network
    Ahn, Namhyuk
    Kang, Byungkon
    Sohn, Kyung-Ah
    [J]. COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 256 - 272
  • [3] Bergstra J., 2010, Proc. 9th Python in Science Conf, P1
  • [4] Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
    Bevilacqua, Marco
    Roumy, Aline
    Guillemot, Christine
    Morel, Marie-Line Alberi
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [5] Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
    Chen, Yunjin
    Pock, Thomas
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) : 1256 - 1272
  • [6] Super-Resolution Enhanced Medical Image Diagnosis With Sample Affinity Interaction
    Chen, Zhen
    Guo, Xiaoqing
    Woo, Peter Y. M.
    Yuan, Yixuan
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (05) : 1377 - 1389
  • [7] Efficient image warping and super-resolution
    Chiang, MC
    Boult, TE
    [J]. THIRD IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION - WACV '96, PROCEEDINGS, 1996, : 56 - 61
  • [8] Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search
    Chu, Xiangxiang
    Zhang, Bo
    Ma, Hailong
    Xu, Ruijun
    Li, Qingyuan
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 59 - 64
  • [9] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [10] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307