A Self-supervised CNN-GCN hybrid network based on latent graph representation for retinal disease diagnosis

被引:2
作者
Yang, Mei [2 ]
Guo, Xiaoxin [1 ,2 ]
Feng, Bo [2 ]
Dong, Hongliang [2 ]
Hu, Xiaoying [3 ]
Che, Songtian [3 ]
机构
[1] Jilin Univ, Key Lab Symbol Computat & Knowledge Engn, Minist Educ, 2699 Qianjin St, Changchun 130012, Peoples R China
[2] Jilin Univ, Coll Comp Sci & Technol, 2699 Qianjin St, Changchun 130012, Peoples R China
[3] Jilin Univ, Ophthalmol Dept, Bethune First Hosp, Changchun 130021, Jilin, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Latent graph representation; Latent instance graph representation; Self-attention; CNN-GCN hybrid network; CONVOLUTIONAL NETWORK; CLASSIFICATION;
D O I
10.1016/j.compeleceng.2024.109447
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a self-supervised CNN-GCN hybrid network (SCGHNet) based on latent graph representation by combining a convolutional neural network (CNN) and a graph convolutional network (GCN), and the Self-Supervised Learning (SSL) is achieved by collaborative tasks. We propose three components for the latent graph representation, including self-attention feature extraction module (SAFEM), latent instance graph representation (LIGR) and latent adaptable softmax (LASoftmax). The proposed SAFEM is used to extract the local and global features from retinal images to satisfy the requirement of the multiscale observation of pathologies. The proposed LIGR is used to explore the relationships among retinal images and promote the concentration of similar samples. The proposed LASoftmax is used to improve the optimization solution. Benefiting from the LASoftmax with LIGR, the latent graph representation can be used to improve the collaborative tasks, enlarge the distance between positvie and negative samples, and obtain more accurate retinal disease diagnosis. In the experiments, our model achieves the AUC of 79.5% and the accuracy of 88.5% for the iChanllenge-AMD dataset. The proposed model outperforms other state-of-the-art SSL models in retinal disease diagnosis of age-related macular degeneration (AMD) and pathological myopia (PM), and shows generalization with outstanding diagnosis performance.
引用
收藏
页数:16
相关论文
共 30 条
  • [11] Huang Y., 2022, arXiv
  • [12] Lesion-Based Contrastive Learning for Diabetic Retinopathy Grading from Fundus Images
    Huang, Yijin
    Lin, Li
    Cheng, Pujin
    Lyu, Junyan
    Tang, Xiaoying
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 113 - 123
  • [13] Huang YN, 2024, Arxiv, DOI arXiv:2402.07595
  • [14] Applying supervised contrastive learning for the detection of diabetic retinopathy and its severity levels from fundus images
    Islam, Md Robiul
    Abdulrazak, Lway Faisal
    Nahiduzzaman, Md
    Goni, Md Omaer Faruq
    Anower, Md Shamim
    Ahsan, Mominul
    Haider, Julfikar
    Kowalski, Marcin
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 146
  • [15] Lee CS, 2017, OPHTHALMOL RETINA, V1, P322, DOI 10.1016/j.oret.2016.12.009
  • [16] Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis
    Li, Xiaomeng
    Hu, Xiaowei
    Qi, Xiaojuan
    Yu, Lequan
    Zhao, Wei
    Heng, Pheng-Ann
    Xing, Lei
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (09) : 2284 - 2294
  • [17] Self-Supervised Feature Learning via Exploiting Multi-Modal Data for Retinal Disease Diagnosis
    Li, Xiaomeng
    Jia, Mengyu
    Islam, Md Tauhidul
    Yu, Lequan
    Xing, Lei
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (12) : 4023 - 4033
  • [18] Deep Learning of Graphs with Ngram Convolutional Neural Networks
    Luo, Zhiling
    Liu, Ling
    Yin, Jianwei
    Li, Ying
    Wu, Zhaohui
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2017, 29 (10) : 2125 - 2139
  • [19] Powers DMW, 2020, Arxiv, DOI arXiv:2010.16061
  • [20] ImageGCN: Multi-Relational Image Graph Convolutional Networks for Disease Identification With Chest X-Rays
    Mao, Chengsheng
    Yao, Liang
    Luo, Yuan
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (08) : 1990 - 2003