Cytopathology Image Super-Resolution of Portable Microscope Based on Convolutional Window-Integration Transformer

被引:0
作者
Zhang, Jinyu [1 ,2 ]
Cheng, Shenghua [3 ]
Liu, Xiuli [1 ,2 ]
Li, Ning [1 ,2 ]
Rao, Gong [1 ,2 ]
Zeng, Shaoqun [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Britton Chance Ctr, Wuhan Natl Lab Optoelect, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, MoE Key Lab Biomed Photon, Wuhan Natl Lab Optoelect, Wuhan 430074, Peoples R China
[3] Southern Med Univ, Sch Biomed Engn, Guangzhou 510515, Peoples R China
基金
中国博士后科学基金;
关键词
Transformers; Microscopy; Feature extraction; Image reconstruction; Superresolution; Convolutional neural networks; Standards; Convolutional codes; Computer architecture; Computational modeling; Convolutional window-integration; cytopathology image; portable microscope; super-resolution; Transformer;
D O I
10.1109/TCI.2024.3522761
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High-quality cytopathology images are the guarantee of cervical cancer computer-aided screening. However, obtaining such images is dependent on expensive devices, which hinders the screening popularization in less developed areas. In this study, we propose a convolutional window-integration Transformer for cytopathology image super-resolution (SR) of portable microscope. We use self-attention within the window to integrate patches, and then design a convolutional window-integration feed-forward network with two 5 x 5 size kernels to achieve cross-window patch integration. This design avoids long-range self-attention and facilitates SR local mapping learning. Besides, we design a multi-layer feature fusion in feature extraction to enhance high-frequency details, achieving better SR reconstruction. Finally, we register and establish a dataset of 239,100 paired portable microscope images and standard microscope images based on feature point matching. A series of experiments demonstrate that our model has the minimum parameter number and outperforms state-of-the-art CNN-based and recent Transformer-based SR models with PSNR improvement of 0.09-0.53 dB. We release this dataset and codes publicly to promote the development of computational cytopathology imaging.
引用
收藏
页码:77 / 88
页数:12
相关论文
共 48 条
  • [1] Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer
    Bejnordi, Babak Ehteshami
    Veta, Mitko
    van Diest, Paul Johannes
    van Ginneken, Bram
    Karssemeijer, Nico
    Litjens, Geert
    van der Laak, Jeroen A. W. M.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2017, 318 (22): : 2199 - 2210
  • [2] Ben Niu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P191, DOI 10.1007/978-3-030-58610-2_12
  • [3] Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
  • [4] Pre-Trained Image Processing Transformer
    Chen, Hanting
    Wang, Yunhe
    Guo, Tianyu
    Xu, Chang
    Deng, Yiping
    Liu, Zhenhua
    Ma, Siwei
    Xu, Chunjing
    Xu, Chao
    Gao, Wen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12294 - 12305
  • [5] Simultaneously enhancing the ultimate strength and ductility of high-entropy alloys via short-range ordering
    Chen, Shuai
    Aitken, Zachary H.
    Pattamatta, Subrahmanyam
    Wu, Zhaoxuan
    Yu, Zhi Gen
    Srolovitz, David J.
    Liaw, Peter K.
    Zhang, Yong-Wei
    [J]. NATURE COMMUNICATIONS, 2021, 12 (01)
  • [6] Activating More Pixels in Image Super-Resolution Transformer
    Chen, Xiangyu
    Wang, Xintao
    Zhou, Jiantao
    Qiao, Yu
    Dong, Chao
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 22367 - 22377
  • [7] Conde M.V., 2022, EUR C COMP VIS, P669, DOI [10.1007/978-3-031-25063-7_42, DOI 10.1007/978-3-031-25063-742]
  • [8] Second-order Attention Network for Single Image Super-Resolution
    Dai, Tao
    Cai, Jianrui
    Zhang, Yongbing
    Xia, Shu-Tao
    Zhang, Lei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11057 - 11066
  • [9] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [10] Dosovitskiy A., 2021, IMAGE IS WORTH 1616