Data efficient contrastive learning in histopathology using active sampling

被引:0
作者
Reasat, Tahsin [1 ]
Sushmit, Asif [2 ]
Smith, David S. [1 ,3 ]
机构
[1] Vanderbilt Univ, Dept Elect & Comp Engn, Nashville, TN 37235 USA
[2] Bengali AI, Dhaka 1215, Bangladesh
[3] Vanderbilt Univ, Med Ctr, Inst Imaging Sci, Nashville, TN 37232 USA
来源
MACHINE LEARNING WITH APPLICATIONS | 2024年 / 17卷
关键词
Contrastive learning; Active learning; Histopathology;
D O I
10.1016/j.mlwa.2024.100577
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning (DL) based diagnostics systems can provide accurate and robust quantitative analysis in digital pathology. These algorithms require large amounts of annotated training data which is impractical in pathology due to the high resolution of histopathological images. Hence, self-supervised methods have been proposed to learn features using ad-hoc pretext tasks. The self-supervised training process uses a large unlabeled dataset which makes the learning process time consuming. In this work, we propose a new method for actively sampling informative members from the training set using a small proxy network, decreasing sample requirement by 93% and training time by 62% while maintaining the same performance of the traditional self-supervised learning method. The code is available on github.
引用
收藏
页数:9
相关论文
共 35 条
  • [1] Bayramoglu N, 2016, INT C PATT RECOG, P2440, DOI 10.1109/ICPR.2016.7900002
  • [2] Budd S, 2021, Arxiv, DOI arXiv:1910.02923
  • [3] SMOTE: Synthetic minority over-sampling technique
    Chawla, Nitesh V.
    Bowyer, Kevin W.
    Hall, Lawrence O.
    Kegelmeyer, W. Philip
    [J]. 2002, American Association for Artificial Intelligence (16)
  • [4] Chen T, 2020, Arxiv, DOI arXiv:2002.05709
  • [5] Cicalese Pietro Antonio, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12265), P351, DOI 10.1007/978-3-030-59722-1_34
  • [6] Self supervised contrastive learning for digital histopathology
    Ciga, Ozan
    Xu, Tony
    Martel, Anne Louise
    [J]. MACHINE LEARNING WITH APPLICATIONS, 2022, 7
  • [7] COHN D, 1994, MACH LEARN, V15, P201, DOI 10.1007/BF00993277
  • [8] Coleman C, 2020, Arxiv, DOI arXiv:1906.11829
  • [9] Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning
    Coudray, Nicolas
    Ocampo, Paolo Santiago
    Sakellaropoulos, Theodore
    Narula, Navneet
    Snuderl, Matija
    Fenyo, David
    Moreira, Andre L.
    Razavian, Narges
    Tsirigos, Aristotelis
    [J]. NATURE MEDICINE, 2018, 24 (10) : 1559 - +
  • [10] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848