A Self-supervised CNN-GCN hybrid network based on latent graph representation for retinal disease diagnosis

被引:2
作者
Yang, Mei [2 ]
Guo, Xiaoxin [1 ,2 ]
Feng, Bo [2 ]
Dong, Hongliang [2 ]
Hu, Xiaoying [3 ]
Che, Songtian [3 ]
机构
[1] Jilin Univ, Key Lab Symbol Computat & Knowledge Engn, Minist Educ, 2699 Qianjin St, Changchun 130012, Peoples R China
[2] Jilin Univ, Coll Comp Sci & Technol, 2699 Qianjin St, Changchun 130012, Peoples R China
[3] Jilin Univ, Ophthalmol Dept, Bethune First Hosp, Changchun 130021, Jilin, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Latent graph representation; Latent instance graph representation; Self-attention; CNN-GCN hybrid network; CONVOLUTIONAL NETWORK; CLASSIFICATION;
D O I
10.1016/j.compeleceng.2024.109447
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a self-supervised CNN-GCN hybrid network (SCGHNet) based on latent graph representation by combining a convolutional neural network (CNN) and a graph convolutional network (GCN), and the Self-Supervised Learning (SSL) is achieved by collaborative tasks. We propose three components for the latent graph representation, including self-attention feature extraction module (SAFEM), latent instance graph representation (LIGR) and latent adaptable softmax (LASoftmax). The proposed SAFEM is used to extract the local and global features from retinal images to satisfy the requirement of the multiscale observation of pathologies. The proposed LIGR is used to explore the relationships among retinal images and promote the concentration of similar samples. The proposed LASoftmax is used to improve the optimization solution. Benefiting from the LASoftmax with LIGR, the latent graph representation can be used to improve the collaborative tasks, enlarge the distance between positvie and negative samples, and obtain more accurate retinal disease diagnosis. In the experiments, our model achieves the AUC of 79.5% and the accuracy of 88.5% for the iChanllenge-AMD dataset. The proposed model outperforms other state-of-the-art SSL models in retinal disease diagnosis of age-related macular degeneration (AMD) and pathological myopia (PM), and shows generalization with outstanding diagnosis performance.
引用
收藏
页数:16
相关论文
共 30 条
  • [1] Atito S., 2021, arXiv
  • [2] Uni4Eye: Unified 2D and 3D Self-supervised Pre-training via Masked Image Modeling Transformer for Ophthalmic Image Classification
    Cai, Zhiyuan
    Lin, Li
    He, Huaqing
    Tang, Xiaoying
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VIII, 2022, 13438 : 88 - 98
  • [3] Chen T, 2020, PR MACH LEARN RES, V119
  • [4] D'Souza NS, 2021, PR MACH LEARN RES, V143, P119
  • [5] AUTOMATIC DETECTION OF PATHOLOGICAL MYOPIA AND HIGH MYOPIA ON FUNDUS IMAGES
    Dai, Siying
    Chen, Leiting
    Lei, Ting
    Zhou, Chuan
    Wen, Yang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [6] Multidimensional Hypergraph on Delineated Retinal Features for Pathological Myopia Task
    Githinji, Bilha
    Shao, Lei
    An, Lin
    Zhang, Hao
    Li, Fang
    Dong, Li
    Ma, Lan
    Dong, Yuhan
    Zhang, Yongbing
    Wei, Wen B.
    Qin, Peiwu
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 : 550 - 559
  • [7] SAE-wAMD: A Self-Attention Enhanced convolution neural network for fine-grained classification of wet Age-Related Macular Degeneration using OCT Images
    Haihong, E.
    Ding, Junpeng
    Yuan, Lifei
    [J]. 2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 619 - 627
  • [8] Momentum Contrast for Unsupervised Visual Representation Learning
    He, Kaiming
    Fan, Haoqi
    Wu, Yuxin
    Xie, Saining
    Girshick, Ross
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 9726 - 9735
  • [9] Multi-Modal Retinal Image Classification With Modality-Specific Attention Network
    He, Xingxin
    Deng, Ying
    Fang, Leyuan
    Peng, Qinghua
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (06) : 1591 - 1602
  • [10] Self-supervised retinal thickness prediction enables deep learning from unlabelled data to boost classification of diabetic retinopathy
    Holmberg, Olle G.
    Kohler, Niklas D.
    Martins, Thiago
    Siedlecki, Jakob
    Herold, Tina
    Keidel, Leonie
    Asani, Ben
    Schiefelbein, Johannes
    Priglinger, Siegfried
    Kortuem, Karsten U.
    Theis, Fabian J.
    [J]. NATURE MACHINE INTELLIGENCE, 2020, 2 (11) : 719 - 726