Cartesian Product Based Transfer Learning Implementation for Brain Tumor Classification

被引:2
作者
Usmani, Irfan Ahmed [1 ]
Qadri, Muhammad Tahir [1 ]
Zia, Razia [1 ]
Aziz, Asif [2 ]
Saeed, Farheen [3 ]
机构
[1] Sir Syed Univ Engn & Technol, Elect Engn Dept, Karachi 75300, Pakistan
[2] Bahria Univ, Dept Comp Sci, Karachi Campus, Karachi 75260, Pakistan
[3] Christus Trinity Clin, Christus, TX USA
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2022年 / 73卷 / 02期
关键词
Deep transfer learning; Cartesian product; hyperparameter optimization; magnetic resonance imaging (MRI); brain tumor classification; DEEP NEURAL-NETWORKS; SEGMENTATION; GLIOMAS; IMAGES; EXTRACTION;
D O I
10.32604/cmc.2022.030698
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Knowledge-based transfer learning techniques have shown good performance for brain tumor classification, especially with small datasets. However, to obtain an optimized model for targeted brain tumor classification, it is challenging to select a pre-trained deep learning (DL) model, optimal values of hyperparameters, and optimization algorithm (solver). This paper first presents a brief review of recent literature related to brain tumor classification. Secondly, a robust framework for implementing the transfer learning technique is proposed. In the proposed framework, a Cartesian product matrix is generated to determine the optimal values of the two important hyperparameters: batch size and learning rate. An extensive exercise consisting of 435 simulations for 11 state-of-the-art pre-trained DL models was performed using 16 paired hyperparameters from the Cartesian product matrix to input the model with the three most popular solvers (stochastic gradient descent with momentum (SGDM), adaptive moment estimation (ADAM), and root mean squared propagation (RMSProp)). The 16 pairs were formed using individual hyperparameter values taken from literature, which generally addressed only one hyperparameter for optimization, rather than making a grid for a particular range. The proposed framework was assessed using a multi-class publicly available dataset consisting of glioma, meningioma, and pituitary tumors. Performance assessment shows that ResNet18 outperforms all other models in terms of accuracy, precision, specificity, and recall (sensitivity). The results are also compared with existing state-of-the-art research work that used the same dataset. The comparison was mainly based on performance metric ???accuracy??? with support of three other parameters ???precision,??? ???recall,??? and ???specificity.??? The comparison shows that the transfer learning technique, implemented through our proposed framework for brain tumor classification, outperformed all existing approaches. To the best of our knowledge, the proposed framework is an efficient framework that helped reduce the computational complexity and the time to attain optimal values of two important hyperparameters and consequently the optimized model with an accuracy of 99.56%.
引用
收藏
页码:4369 / 4392
页数:24
相关论文
共 74 条
  • [11] Collobert R., 2008, PROC INT C MACHINE L, P160, DOI DOI 10.1145/1390156.1390177
  • [12] A Transfer-Learning Approach for Accelerated MRI Using Deep Neural Networks
    Dar, Salman Ul Hassan
    Ozbey, Muzaffer
    Catli, Ahmet Burak
    Cukur, Tolga
    [J]. MAGNETIC RESONANCE IN MEDICINE, 2020, 84 (02) : 663 - 685
  • [13] Brain tumor classification using deep CNN features via transfer learning
    Deepak, S.
    Ameer, P. M.
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2019, 111
  • [14] Drevelegas A, 2011, IMAGING OF BRAIN TUMORS WITH HISTOLOGICAL CORRELATIONS, SECOND EDITION, P13, DOI 10.1007/978-3-540-87650-2_2
  • [15] Everingham M., 2011, Tech. Rep
  • [16] Ghafoorian Mohsen, 2017, Medical Image Computing and Computer Assisted Intervention MICCAI 2017. 20th International Conference. Proceedings: LNCS 10435, P516, DOI 10.1007/978-3-319-66179-7_59
  • [17] Haarburger C., 2018, P BILDV MED, P216
  • [18] Brain tumor segmentation with Deep Neural Networks
    Havaei, Mohammad
    Davy, Axel
    Warde-Farley, David
    Biard, Antoine
    Courville, Aaron
    Bengio, Yoshua
    Pal, Chris
    Jodoin, Pierre-Marc
    Larochelle, Hugo
    [J]. MEDICAL IMAGE ANALYSIS, 2017, 35 : 18 - 31
  • [19] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [20] Reducing the dimensionality of data with neural networks
    Hinton, G. E.
    Salakhutdinov, R. R.
    [J]. SCIENCE, 2006, 313 (5786) : 504 - 507