Adaptive Multispectral Encoding Network for Image Demoireing

被引:8
作者
Dai, Qiang [1 ]
Cheng, Xi [2 ]
Zhang, Li [1 ]
Sun, Lekang [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing 210003, Peoples R China
关键词
Adaptive multispectral encoding (AMSE); demoireing convolutional network block (DMCNB); image demoireing; moire pattern;
D O I
10.1109/TIM.2023.3280518
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Moire often appears when photographing textured objects, which can seriously degrade the quality of captured photographs. Due to the wide distribution of moire and the dynamic properties of moire, it is a challenge to effectively remove moire patterns. For this purpose, we present an adaptive multispectral encoding network (AMSDM) for image demoireing. In AMSDM, we leverage a multiscale network structure to process moire images at different spatial resolutions, which can relieve the issue of moire with distributed frequency spectrum. To solve the issue of dynamic properties of moire, we design an adaptive multispectral encoding (AMSE) module to encode moire patterns adaptively, which helps AMSDM restore moire images clearly. Besides, a demoireing convolutional network block (DMCNB) in the AMSE module makes AMSDM have the adaptability and the long-range correlation; thus, it can learn both global and local information about moire images. Extensive experimental results indicate that our proposed AMSDM significantly outperforms state-of-the-art (SOTA) methods and achieves a great balance between performance and efficiency.
引用
收藏
页数:14
相关论文
共 62 条
[1]   DISCRETE COSINE TRANSFORM [J].
AHMED, N ;
NATARAJAN, T ;
RAO, KR .
IEEE TRANSACTIONS ON COMPUTERS, 1974, C 23 (01) :90-93
[2]  
Chen SF, 2022, Arxiv, DOI [arXiv:2107.10224, 10.1109/TPAMI.2023.3303397, DOI 10.1109/TPAMI.2023.3303397]
[3]   Improved multi-scale dynamic feature encoding network for image demoireing [J].
Cheng, Xi ;
Fu, Zhenyong ;
Yang, Jian .
PATTERN RECOGNITION, 2021, 116
[4]   Multi-scale Dynamic Feature Encoding Network for Image Demoireing [J].
Cheng, Xi ;
Fu, Zhenyong ;
Yang, Jian .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :3486-3493
[5]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[6]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[7]  
Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, DOI 10.48550/ARXIV.1810.04805]
[8]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[9]   MOIRE PATTERN REMOVAL WITH MULTI-SCALE FEATURE ENHANCING NETWORK [J].
Gao, Tianyu ;
Guo, Yanqing ;
Zheng, Xin ;
Wang, Qianyu ;
Luo, Xiangyang .
2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, :240-245
[10]  
Geng ZY, 2021, Arxiv, DOI arXiv:2109.04553