CSIE-M: Compressive Sensing Image Enhancement Using Multiple Reconstructed Signals for Internet of Things Surveillance Systems

被引:10
作者
Pham, Chi Do-Kim [1 ]
Yang, Jian [1 ]
Zhou, Jinjia [1 ,2 ]
机构
[1] Hosei Univ, Grad Sch Sci & Engn, Koganei, Tokyo 1848584, Japan
[2] JST, PRESTO, Presto, Saitama 3320012, Japan
关键词
Image reconstruction; Image coding; Decoding; Image enhancement; Internet of Things; Compressed sensing; Cameras; Compressive sensing (CS); deep learning approach for compressed image enhancement; multiple-to-one mapping; RECOVERY;
D O I
10.1109/TII.2021.3082498
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence of things has brought artificial intelligence to the cutting-edge Internet of Things. In recent years, compressive sensing (CS), which relies on sparsity, is widely embedded and expected to bring more energy efficiency and a longer battery lifetime to IoT devices. Different from the other image compression standards, CS can get various reconstructed images by applying different reconstruction algorithms on coded data. Using this property, it is the first time to propose a deep learning based compressive sensing image enhancement framework using multiple reconstructed signals (CSIE-M). In this article, first, images are reconstructed by different CS reconstruction algorithms. Second, reconstructed images are assessed and sorted by a no-reference quality assessment module before being input to the quality enhancement module by order of quality scores. Finally, a multiple-input recurrent dense residual network is designed for exploiting and enriching the useful information from the reconstructed images. Experimental results show that CSIE-M obtains 1.88-8.07 dB peek-signal-to-noise (PSNR) improvement while the state-of-the-art works achieve a 1.69-6.69 dB PSNR improvement under sampling rates from 0.125 to 0.75. On the other hand, using multiple reconstructed versions of the signal can improve 0.19-0.23 dB PSNR, and only 4% reconstructing time is increasing compared to using a reconstructed signal.
引用
收藏
页码:1271 / 1281
页数:11
相关论文
共 32 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Real Image Denoising with Feature Attention [J].
Anwar, Saeed ;
Barnes, Nick .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3155-3164
[3]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[4]   A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration [J].
Bioucas-Dias, Jose M. ;
Figueiredo, Mario A. T. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) :2992-3004
[5]  
Candes E., 2005, l1-magic: Recovery of sparse signals via convex programming, V4, P14
[6]   Group sparse optimization by alternating direction method [J].
Deng, Wei ;
Yin, Wotao ;
Zhang, Yin .
WAVELETS AND SPARSITY XV, 2013, 8858
[7]   SPARSITY ADAPTIVE MATCHING PURSUIT ALGORITHM FOR PRACTICAL COMPRESSED SENSING [J].
Do, Thong T. ;
Gan, Lu ;
Nguyen, Nam ;
Tran, Trac D. .
2008 42ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, VOLS 1-4, 2008, :581-+
[8]   Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit [J].
Donoho, David L. ;
Tsaig, Yaakov ;
Drori, Iddo ;
Starck, Jean-Luc .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2012, 58 (02) :1094-1121
[9]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[10]   Blind Universal Bayesian Image Denoising With Gaussian Noise Level Learning [J].
El Helou, Majed ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4885-4897