Morph-SSL: Self-Supervision With Longitudinal Morphing for Forecasting AMD Progression From OCT Volumes

被引:3
作者
Chakravarty, Arunava [1 ]
Emre, Taha [1 ]
Leingang, Oliver [1 ]
Riedl, Sophie [1 ]
Mai, Julia [1 ]
Scholl, Hendrik P. N. [2 ,3 ]
Sivaprasad, Sobha [4 ]
Rueckert, Daniel [5 ,6 ]
Lotery, Andrew [7 ]
Schmidt-Erfurth, Ursula [1 ]
Bogunovic, Hrvoje [1 ,8 ]
机构
[1] Med Univ Vienna, Dept Ophthalmol & Optometry, A-1090 Vienna, Austria
[2] Inst Mol & Clin Ophthalmol Basel, CH-4031 Basel, Switzerland
[3] Univ Basel, Dept Ophthalmol, CH-4001 Basel, Switzerland
[4] Moorfields Eye Hosp NHS Fdn Trust, NIHR Moorfields Biomed Res Ctr, London EC1V 2PD, England
[5] Imperial Coll London, BioMedIA, London SW7 2AZ, England
[6] Tech Univ Munich, Inst AI & Informat Med, Klinikum Rechts Isar, D-80333 Munich, Germany
[7] Univ Southampton, Fac Med, Clin & Expt Sci, Southampton SO17 1BJ, England
[8] Med Univ Vienna, Christian Doppler Lab Artificial Intelligence Reti, A-1090 Vienna, Austria
基金
英国惠康基金; 奥地利科学基金会;
关键词
Training; Retina; Task analysis; Feature extraction; Biomedical imaging; Three-dimensional displays; Biomarkers; Self-supervised learning; disease progression; age-related macular degeneration; retina; longitudinal OCT; MACULAR DEGENERATION; DISEASE; PREDICTION;
D O I
10.1109/TMI.2024.3390940
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The lack of reliable biomarkers makes predicting the conversion from intermediate to neovascular age-related macular degeneration (iAMD, nAMD) a challenging task. We develop a Deep Learning (DL) model to predict the future risk of conversion of an eye from iAMD to nAMD from its current OCT scan. Although eye clinics generate vast amounts of longitudinal OCT scans to monitor AMD progression, only a small subset can be manually labeled for supervised DL. To address this issue, we propose Morph-SSL, a novel Self-supervised Learning (SSL) method for longitudinal data. It uses pairs of unlabelled OCT scans from different visits and involves morphing the scan from the previous visit to the next. The Decoder predicts the transformation for morphing and ensures a smooth feature manifold that can generate intermediate scans between visits through linear interpolation. Next, the Morph-SSL trained features are input to a Classifier which is trained in a supervised manner to model the cumulative probability distribution of the time to conversion with a sigmoidal function. Morph-SSL was trained on unlabelled scans of 399 eyes (3570 visits). The Classifier was evaluated with a five-fold cross-validation on 2418 scans from 343 eyes with clinical labels of the conversion date. The Morph-SSL features achieved an AUC of 0.779 in predicting the conversion to nAMD within the next 6 months, outperforming the same network when trained end-to-end from scratch or pre-trained with popular SSL methods. Automated prediction of the future risk of nAMD onset can enable timely treatment and individualized AMD management.
引用
收藏
页码:3224 / 3239
页数:16
相关论文
共 47 条
  • [1] Big Self-Supervised Models Advance Medical Image Classification
    Azizi, Shekoofeh
    Mustafa, Basil
    Ryan, Fiona
    Beaver, Zachary
    Freyberg, Jan
    Deaton, Jonathan
    Loh, Aaron
    Karthikesalingam, Alan
    Kornblith, Simon
    Chen, Ting
    Natarajan, Vivek
    Norouzi, Mohammad
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3458 - 3468
  • [2] VoxelMorph: A Learning Framework for Deformable Medical Image Registration
    Balakrishnan, Guha
    Zhao, Amy
    Sabuncu, Mert R.
    Guttag, John
    Dalca, Adrian, V
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) : 1788 - 1800
  • [3] Prediction of age-related macular degeneration disease using a sequential deep learning approach on longitudinal SD-OCT imaging biomarkers
    Banerjee, Imon
    de Sisternes, Luis
    Hallak, Joelle A.
    Leng, Theodore
    Osborne, Aaron
    Rosenfeld, Philip J.
    Gregori, Giovanni
    Durbin, Mary
    Rubin, Daniel
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [4] Bardes A., 2022, P ICLR
  • [5] Artificial Intelligence to Stratify Severity of Age-Related Macular Degeneration (AMD) and Predict Risk of Progression to Late AMD
    Bhuiyan, Alauddin
    Wong, Tien Yin
    Ting, Daniel Shu Wei
    Govindaiah, Arun
    Souied, Eric H.
    Smith, R. Theodore
    [J]. TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2020, 9 (02):
  • [6] Machine Learning of the Progression of Intermediate Age-Related Macular Degeneration Based on OCT Imaging
    Bogunovic, Hrvoje
    Montuoro, Alessio
    Baratsits, Magdalena
    Karantonis, Maria G.
    Waldstein, Sebastian M.
    Schlanitz, Ferdinand
    Schmidt-Erfurth, Ursula
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2017, 58 (06) : BIO141 - BIO150
  • [7] Development and validation of a novel prognostic model for predicting AMD progression using longitudinal fundus images
    Bridge, Joshua
    Harding, Simon
    Zheng, Yalin
    [J]. BMJ OPEN OPHTHALMOLOGY, 2020, 5 (01):
  • [8] Use of Deep Learning for Detailed Severity Characterization and Estimation of 5-Year Risk Among Patients With Age-Related Macular Degeneration
    Burlina, Philippe M.
    Joshi, Neil
    Pacheco, Katia D.
    Freund, David E.
    Kong, Jun
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2018, 136 (12) : 1359 - 1366
  • [9] Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
    Carreira, Joao
    Zisserman, Andrew
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4724 - 4733
  • [10] Self-supervised learning for medical image analysis using image context restoration
    Chen, Liang
    Bentley, Paul
    Mori, Kensaku
    Misawa, Kazunari
    Fujiwara, Michitaka
    Rueckert, Daniel
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 58