A multistage and multiresolution deep convolutional neural network for inverse halftoning

被引:4
作者
Li, Mei [1 ,2 ]
Zhang, Erhu [1 ,3 ]
Wu, Lele [3 ]
Duan, Jinghong [4 ]
机构
[1] Xian Univ Technol, Sch Mech & Precis Instrument Engn, Xian 710048, Peoples R China
[2] Yuncheng Univ, Dept Mech & Elect Engn, Yuncheng 044000, Peoples R China
[3] Xian Univ Technol, Dept Informat Sci, Xian 710048, Peoples R China
[4] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Inverse halftoning; Deep convolutional neural network; Multiresolution neural network; Residual dense block; IMAGE QUALITY ASSESSMENT; ALGORITHM;
D O I
10.1016/j.eswa.2021.116358
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inverse halftoning is a technology to restore a continuous-tone image from its halftone version. Recent works based on deep convolutional neural network (DCNN) have shown remarkable progresses in this area. However, it is still a hard work to accurately recover the content information, detail information and global information. To this end, we propose a multistage and multiresolution DCNN method for inverse halftoning. The network includes three sub-networks corresponding three stages, each of them is used to restore different information in a progressive manner. Firstly, a trTresolution analysis network (TRA) is proposed to remove halftone noise dots and then the initial reconstructed image is obtained. Secondly, the detail information is enriched by the detail enhancement sub-network through concatenating the initial reconstructed image and the input halftone image. Finally, a global enhancement sub-network is introduced to adjust information of the whole image. The evaluation results on three public datasets show that the proposed method is superior to the state-of-the-art methods in both visual quality and numerical evaluation. Moreover, the average runtime of the proposed network is 0.14 s for an image with the size of 256 x 256 pixels, which means the proposed network can meet the requirements of practical applications.
引用
收藏
页数:12
相关论文
共 48 条
  • [1] Deep learning for decentralized parking lot occupancy detection
    Amato, Giuseppe
    Carrara, Fabio
    Falchi, Fabrizio
    Gennaro, Claudio
    Meghini, Carlo
    Vairo, Claudio
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2017, 72 : 327 - 334
  • [2] [Anonymous], 1999, Digital Color Halftoning
  • [3] [Anonymous], 2002, IEEE T IMAGE PROCESS
  • [4] Optimised halftoning and inverse halftoning of dermoscopic images for supporting teledermoscopy system
    Ashour, Amira S.
    Guo, Yanhui
    Hawas, Ahmed Refaat
    Du, Chunlai
    [J]. IET IMAGE PROCESSING, 2019, 13 (03) : 529 - 536
  • [5] An adaptive inverse halftoning algorithm
    Chen, LM
    Hang, HM
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 1997, 6 (08) : 1202 - 1209
  • [6] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [7] The PASCAL Visual Object Classes Challenge: A Retrospective
    Everingham, Mark
    Eslami, S. M. Ali
    Van Gool, Luc
    Williams, Christopher K. I.
    Winn, John
    Zisserman, Andrew
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 111 (01) : 98 - 136
  • [8] FLOYD RW, 1976, P SID, V17, P75
  • [9] Freitas P., 2011, 24 SIBGRAPI C GRAPH, DOI [10.1109/SIBGRAPI.2011.14, DOI 10.1109/SIBGRAPI.2011.14]
  • [10] Enhancing inverse halftoning via coupled dictionary training
    Freitas, Pedro G.
    Farias, Mylene C. Q.
    Araujo, Aleteia P. F.
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2016, 49 : 1 - 8