SSCLNet: A Self-Supervised Contrastive Loss-Based Pre-Trained Network for Brain MRI Classification

被引:6
作者
Mishra, Animesh [1 ]
Jha, Ritesh [1 ]
Bhattacharjee, Vandana [1 ]
机构
[1] Birla Inst Technol, Mesra 835215, Ranchi, India
关键词
Self-supervised learning; Magnetic resonance imaging; Brain modeling; Deep learning; Representation learning; Tumors; Convolutional neural networks; Contrastive learning; convolutional neural networks; pre-training; ResNet; self-supervised; SPARSE AUTOENCODER;
D O I
10.1109/ACCESS.2023.3237542
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Brain magnetic resonance images (MRI) convey vital information for making diagnostic decisions and are widely used to detect brain tumors. This research proposes a self-supervised pre-training method based on feature representation learning through contrastive loss applied to unlabeled data. Self-supervised learning aims to understand vital features using the raw input, which is helpful since labeled data is scarce and expensive. For the contrastive loss-based pre-training, data augmentation is applied to the dataset, and positive and negative instance pairs are fed into a deep learning model for feature learning. Subsequently, the features are passed through a neural network model to maximize similarity and contrastive learning of the instances. This pre-trained model serves as an encoder for supervised training and then the classification of MRI images. Our results show that self-supervised pre-training with contrastive loss performs better than random or ImageNet initialization. We also show that contrastive learning performs better when the diversity of images in the pre-training dataset is more. We have taken three differently sized ResNet models as the base models. Further, experiments were also conducted to study the effect of changing the augmentation types for generating positive and negative samples for self-supervised training.
引用
收藏
页码:6673 / 6681
页数:9
相关论文
共 49 条
  • [1] American Cancer Society, US
  • [2] [Anonymous], 2014, P EUR C COMP VIS ZUR
  • [3] [Anonymous], BRAIN TUM DIAGN
  • [4] [Anonymous], 2010, P 13 INT C ARTIFICIA
  • [5] [Anonymous], MRI 2 CLASS DAT
  • [6] [Anonymous], MRI 4 CLASS DAT
  • [7] Azizpour Hossein, 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), P36, DOI 10.1109/CVPRW.2015.7301270
  • [8] Bachman P, 2019, ADV NEUR IN, V32
  • [9] Classification of Brain Tumors from MRI Images Using a Convolutional Neural Network
    Badza, Milica M.
    Barjaktarovic, Marko C.
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (06):
  • [10] SELF-ORGANIZING NEURAL NETWORK THAT DISCOVERS SURFACES IN RANDOM-DOT STEREOGRAMS
    BECKER, S
    HINTON, GE
    [J]. NATURE, 1992, 355 (6356) : 161 - 163