HLFSRNN-MIL: A Hybrid Multi-Instance Learning Model for 3D CT Image Classification

被引:0
作者
Chen, Huilong [1 ]
Zhang, Xiaoxia [1 ]
机构
[1] Univ Sci & Technol Liaoning, Sch Comp Sci & Software Engn, Anshan 114051, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 14期
关键词
3D CT images; multiple-instance learning; convolutional neural network; deep learning; lung cancer; COVID-19; DIAGNOSIS;
D O I
10.3390/app14146186
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
At present, many diseases are diagnosed by computer tomography (CT) image technology, which affects the health of the lives of millions of people. In the process of disease confrontation, it is very important for patients to detect diseases in the early stage by deep learning of 3D CT images. The paper offers a hybrid multi-instance learning model (HLFSRNN-MIL), which hybridizes high-low frequency feature fusion (HLFFF) with sequential recurrent neural network (SRNN) for CT image classification tasks. Firstly, the hybrid model uses Resnet-50 as the deep feature. The main feature of the HLFSRNN-MIL lies in its ability to make full use of the advantages of the HLFFF and SRNN methods to make up for their own weakness; i.e., the HLFFF can extract more targeted feature information to avoid the problem of excessive gradient fluctuation during training, and the SRNN is used to process the time-related sequences before classification. The experimental study of the HLFSRNN-MIL model is on two public CT datasets, namely, the Cancer Imaging Archive (TCIA) dataset on lung cancer and the China Consortium of Chest CT Image Investigation (CC-CCII) dataset on pneumonia. The experimental results show that the model exhibits better performance and accuracy. On the TCIA dataset, HLFSRNN-MIL with Residual Network (ResNet) as the feature extractor achieves an accuracy (ACC) of 0.992 and an area under curve (AUC) of 0.997. On the CC-CCII dataset, HLFSRNN-MIL achieves an ACC of 0.994 and an AUC of 0.997. Finally, compared with the existing methods, HLFSRNN-MIL has obvious advantages in all aspects. These experimental results demonstrate that HLFSRNN-MIL can effectively solve the disease problem in the field of 3D CT images.
引用
收藏
页数:20
相关论文
共 45 条
[1]   A Large Imaging Database and Novel Deep Neural Architecture for Covid-19 Diagnosis [J].
Arsenos, Anastasios ;
Kollias, Dimitrios ;
Kollias, Stefanos .
2022 IEEE 14TH IMAGE, VIDEO, AND MULTIDIMENSIONAL SIGNAL PROCESSING WORKSHOP (IVMSP), 2022,
[2]   Deep multiple instance learning for predicting chemotherapy response in non-small cell lung cancer using pretreatment CT images [J].
Chang, Runsheng ;
Qi, Shouliang ;
Wu, Yanan ;
Song, Qiyuan ;
Yue, Yong ;
Zhang, Xiaoye ;
Guan, Yubao ;
Qian, Wei .
SCIENTIFIC REPORTS, 2022, 12 (01)
[3]   Study on high-precision three-dimensional reconstruction of pulmonary lesions and surrounding blood vessels based on CT images [J].
Chen, Chaoxiang ;
Fu, Zhiyong ;
Ye, Shengli ;
Zhao, Chenlu ;
Golovko, Vladimir ;
Ye, Shiping ;
Bai, Zhican .
OPTICS EXPRESS, 2024, 32 (02) :1371-1390
[4]   Lung cancer diagnosis using deep attention-based multiple instance learning and radiomics [J].
Chen, Junhua ;
Zeng, Haiyan ;
Zhang, Chong ;
Shi, Zhenwei ;
Dekker, Andre ;
Wee, Leonard ;
Bermejo, Inigo .
MEDICAL PHYSICS, 2022, 49 (05) :3134-3143
[5]   MILES: Multiple-Instance Learning via Embedded instance Selection [J].
Chen, Yixin ;
Bi, Jinbo ;
Wang, James Z. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :1931-1947
[6]   Label Stability in Multiple Instance Learning [J].
Cheplygina, Veronika ;
Sorensen, Lauge ;
Tax, David M. J. ;
de Bruijne, Marleen ;
Loog, Marco .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2015, PT I, 2015, 9349 :539-546
[7]   Multiple instance learning with bag dissimilarities [J].
Cheplygina, Veronika ;
Tax, David M. J. ;
Loog, Marco .
PATTERN RECOGNITION, 2015, 48 (01) :264-275
[8]   Solving the multiple instance problem with axis-parallel rectangles [J].
Dietterich, TG ;
Lathrop, RH ;
LozanoPerez, T .
ARTIFICIAL INTELLIGENCE, 1997, 89 (1-2) :31-71
[9]   Evaluation of emphysema on thoracic low-dose CTs through attention-based multiple instance deep learning [J].
Fuhrman, Jordan ;
Yip, Rowena ;
Zhu, Yeqing ;
Jirapatnakul, Artit C. ;
Li, Feng ;
Henschke, Claudia I. ;
Yankelevitz, David F. ;
Giger, Maryellen L. .
SCIENTIFIC REPORTS, 2023, 13 (01)
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778