Adaptive Super-Resolution Networks for Single-Pixel Imaging at Ultra-Low Sampling Rates

被引:0
作者
Liu, Zonghao [1 ]
Zhang, Huan [1 ]
Zhou, Mi [1 ]
Jiao, Shuming [2 ]
Zhang, Xiao-Ping [1 ]
Geng, Zihan [1 ]
机构
[1] Tsinghua Univ, Inst Data & Informat, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Guangdong, Peoples R China
[2] Shenzhen Smart Holog Technol Ltd, Shenzhen 518055, Guangdong, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Single-pixel imaging; super-resolution; generative adversarial network; computational imaging; perceptual image-error assessment; ultra-low sampling rate; ultrafast imaging;
D O I
10.1109/ACCESS.2024.3402693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single-pixel imaging (SPI) leverages sequential pattern illumination and intensity detection to reconstruct images, facing the challenge of balancing high-resolution output with ultra-low sampling rates for rapid imaging processes. We introduce a network architecture specifically tailored for SPI, which demonstrates improved performance even before integrating with SPI's physical sampling processes. This integration, particularly focusing on the nuanced effects of sampling rates within the model's loss function and data preprocessing, enhances image reconstruction quality and adaptability at low sampling rates, down to 1.56%. Our approach achieves a balance between advanced computational methods and the physical principles of SPI, resulting in a peak signal-to-noise ratio of 30.93 dB, a structural similarity index measure of 0.8818, and a perceptual index (PI) of 5.31 at a 6.25% sampling rate, alongside a notable PI of 2.68 at a 1.56% sampling rate in practical tests. By merging sophisticated network design with strategic integration of physical sampling rates, our model provides a refined solution for high-quality, high-resolution SPI at minimal sampling rates, facilitating progress in ultra-fast imaging applications.
引用
收藏
页码:78496 / 78504
页数:9
相关论文
共 60 条
  • [1] NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
    Agustsson, Eirikur
    Timofte, Radu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1122 - 1131
  • [2] Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
    Bevilacqua, Marco
    Roumy, Aline
    Guillemot, Christine
    Morel, Marie-Line Alberi
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [3] The 2018 PIRM Challenge on Perceptual Image Super-Resolution
    Blau, Yochai
    Mechrez, Roey
    Timofte, Radu
    Michaeli, Tomer
    Zelnik-Manor, Lihi
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 334 - 355
  • [4] Bruna J., 2015, arXiv
  • [5] Çelik S, 2016, 2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), P1441, DOI 10.1109/SIU.2016.7496021
  • [6] Improving ESRGAN with an additional image quality loss
    Choi, Yoonsil
    Park, Hanhoon
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (02) : 3123 - 3137
  • [7] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [8] Single-pixel imaging via compressive sampling
    Duarte, Marco F.
    Davenport, Mark A.
    Takhar, Dharmpal
    Laska, Jason N.
    Sun, Ting
    Kelly, Kevin F.
    Baraniuk, Richard G.
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (02) : 83 - 91
  • [9] Principles and prospects for single-pixel imaging
    Edgar, Matthew P.
    Gibson, Graham M.
    Padgett, Miles J.
    [J]. NATURE PHOTONICS, 2019, 13 (01) : 13 - 20
  • [10] High-turbidity underwater active single-pixel imaging based on generative adversarial networks with double Attention U-Net under low sampling rate
    Feng, Wei
    Zhou, Shiqi
    Li, Shuyang
    Yi, Yongcong
    Zhai, Zhongsheng
    [J]. OPTICS COMMUNICATIONS, 2023, 538