Transfer Learning in Magnetic Resonance Brain Imaging: A Systematic Review

被引:67
作者
Valverde, Juan Miguel [1 ]
Imani, Vandad [1 ]
Abdollahzadeh, Ali [1 ]
De Feo, Riccardo [1 ]
Prakash, Mithilesh [1 ]
Ciszek, Robert [1 ]
Tohka, Jussi [1 ]
机构
[1] Univ Eastern Finland, AI Virtanen Inst Mol Sci, Kuopio 70150, Finland
基金
芬兰科学院; 欧盟地平线“2020”;
关键词
transfer learning; magnetic resonance imaging; brain; systematic review; survey; machine learning; artificial intelligence; convolutional neural networks; ALZHEIMERS-DISEASE; NEURAL-NETWORK; DOMAIN ADAPTATION; TUMOR SEGMENTATION; MR-IMAGES; CLASSIFICATION; AGE; SIMILARITY; PREDICTION; SELECTION;
D O I
10.3390/jimaging7040066
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
(1) Background: Transfer learning refers to machine learning techniques that focus on acquiring knowledge from related tasks to improve generalization in the tasks of interest. In magnetic resonance imaging (MRI), transfer learning is important for developing strategies that address the variation in MR images from different imaging protocols or scanners. Additionally, transfer learning is beneficial for reutilizing machine learning models that were trained to solve different (but related) tasks to the task of interest. The aim of this review is to identify research directions, gaps in knowledge, applications, and widely used strategies among the transfer learning approaches applied in MR brain imaging; (2) Methods: We performed a systematic literature search for articles that applied transfer learning to MR brain imaging tasks. We screened 433 studies for their relevance, and we categorized and extracted relevant information, including task type, application, availability of labels, and machine learning methods. Furthermore, we closely examined brain MRI-specific transfer learning approaches and other methods that tackled issues relevant to medical imaging, including privacy, unseen target domains, and unlabeled data; (3) Results: We found 129 articles that applied transfer learning to MR brain imaging tasks. The most frequent applications were dementia-related classification tasks and brain tumor segmentation. The majority of articles utilized transfer learning techniques based on convolutional neural networks (CNNs). Only a few approaches utilized clearly brain MRI-specific methodology, and considered privacy issues, unseen target domains, or unlabeled data. We proposed a new categorization to group specific, widely-used approaches such as pretraining and fine-tuning CNNs; (4) Discussion: There is increasing interest in transfer learning for brain MRI. Well-known public datasets have clearly contributed to the popularity of Alzheimer's diagnostics/prognostics and tumor segmentation as applications. Likewise, the availability of pretrained CNNs has promoted their utilization. Finally, the majority of the surveyed studies did not examine in detail the interpretation of their strategies after applying transfer learning, and did not compare their approach with other transfer learning approaches.
引用
收藏
页数:21
相关论文
共 174 条
[1]   Deep learning encodes robust discriminative neuroimaging representations to outperform standard machine learning [J].
Abrol, Anees ;
Fu, Zening ;
Salman, Mustafa ;
Silva, Rogers ;
Du, Yuhui ;
Plis, Sergey ;
Calhoun, Vince .
NATURE COMMUNICATIONS, 2021, 12 (01)
[2]   Deep residual learning for neuroimaging: An application to predict progression to Alzheimer's disease [J].
Abrol, Anees ;
Bhattarai, Manish ;
Fedorov, Alex ;
Du, Yuhui ;
Plis, Sergey ;
Calhoun, Vince .
JOURNAL OF NEUROSCIENCE METHODS, 2020, 339
[3]   Unsupervised Domain Adaptation With Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions From MRI Data [J].
Ackaouy, Antoine ;
Courty, Nicolas ;
Vallee, Emmanuel ;
Commowick, Olivier ;
Barillot, Christian ;
Galassi, Francesca .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2020, 14
[4]   Classification of Alzheimer Disease on Imaging Modalities with Deep CNNs using Cross-Modal Transfer Learning [J].
Aderghal, Karim ;
Khvostikov, Alexander ;
Krylov, Andrei ;
Benois-Pineau, Jenny ;
Afdel, Karim ;
Catheline, Gwenaelle .
2018 31ST IEEE INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS 2018), 2018, :345-350
[5]   On automated source selection for transfer learning in convolutional neural networks [J].
Afridi, Muhammad Jamal ;
Ross, Arun ;
Shapiro, Erik M. .
PATTERN RECOGNITION, 2018, 73 :65-75
[6]   Semisupervised learning using denoising autoencoders for brain lesion detection and segmentation [J].
Alex V. ;
Vaidhya K. ;
Thirunavukkarasu S. ;
Kesavadas C. ;
Krishnamurthi G. .
Journal of Medical Imaging, 2017, 4 (04)
[7]   Domain Mapping and Deep Learning from Multiple MRI Clinical Datasets for Prediction of Molecular Subtypes in Low Grade Gliomas [J].
Ali, Muhaddisa Barat ;
Gu, Irene Yu-Hua ;
Berger, Mitchel S. ;
Pallud, Johan ;
Southwell, Derek ;
Widhalm, Georg ;
Roux, Alexandre ;
Vecchio, Tomas Gomez ;
Jakola, Asgeir Store .
BRAIN SCIENCES, 2020, 10 (07) :1-20
[8]   A New Approach for Brain Tumor Segmentation and Classification Based on Score Level Fusion Using Transfer Learning [J].
Amin, Javeria ;
Sharif, Muhammad ;
Yasmin, Mussarat ;
Saba, Tanzila ;
Anjum, Muhammad Almas ;
Fernandes, Steven Lawrence .
JOURNAL OF MEDICAL SYSTEMS, 2019, 43 (11)
[9]  
[Anonymous], 2017, INT MICCAI BRAIN LES
[10]   Fast and Precise Hippocampus Segmentation Through Deep Convolutional Neural Network Ensembles and Transfer Learning [J].
Ataloglou, Dimitrios ;
Dimou, Anastasios ;
Zarpalas, Dimitrios ;
Daras, Petros .
NEUROINFORMATICS, 2019, 17 (04) :563-582