Research on Combining Self-Attention and Convolution for Chest X-Ray Disease Classification

被引:0
|
作者
Guan Xin [1 ]
Geng Jingjing [1 ]
Li Qiang [1 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin 300072, Peoples R China
关键词
chest X-ray; omni-dimensional dynamic convolution; self-attention; double path attention; disease classification;
D O I
10.3788/LOP231180
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Chest X-rays are used to diagnose a wide range of chest conditions. However, due to the complicated and diverse features of thoracic diseases, existing disease classification algorithms for chest radiographs have difficulty in learning the complex discriminating features of thoracic diseases and do not fully consider correlation information between different diseases. This study proposes a disease classification algorithm that combines self-attention and convolution to address these problems. This study employs omni-dimensional dynamic convolution to replace the standard convolution of the residual network to enhance the feature extraction capabilities of the network for multi-scale information. In addition, a self-attention module is introduced into the convolutional neural network to provide global receptive fields that capture correlations between multiple diseases. Finally, an efficient double path attention is proposed that allows the network to give greater attention to the focal area and automatic capturing of changes in lesion locations. The proposed model is evaluated on the ChestX-ray14 dataset. Experimental results show that the accuracy of the algorithm and the efficiency of diagnosis for the classification of 14 chest diseases is improved over those of the seven current state-of-the-art algorithms, with an average area under receiver operating characteristic curve (AUC) value of 0. 839.
引用
收藏
页数:10
相关论文
共 25 条
  • [1] Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network
    Anthimopoulos, Marios
    Christodoulidis, Stergios
    Ebner, Lukas
    Christe, Andreas
    Mougiakakou, Stavroula
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (05) : 1207 - 1216
  • [2] Application of principal axes for registration of NMR image sequences
    Bülow, H
    Dooley, L
    Wermser, D
    [J]. PATTERN RECOGNITION LETTERS, 2000, 21 (04) : 329 - 336
  • [3] Two -stream collaborative network for multi -label chest X-ray Image classification with lung segmentation
    Chen, Bingzhi
    Zhang, Zheng
    Lin, Jianyong
    Chen, Yi
    Lu, Guangming
    [J]. PATTERN RECOGNITION LETTERS, 2020, 135 : 221 - 227
  • [4] Object extraction from T2 weighted brain MR image using histogram based gradient calculation
    Gilanie, Ghulam
    Attique, Muhammad
    Hafeez-Ullah
    Naweed, Shahid
    Ahmed, Ejaz
    Ikram, Masroor
    [J]. PATTERN RECOGNITION LETTERS, 2013, 34 (12) : 1356 - 1363
  • [5] Discriminative Feature Learning for Thorax Disease Classification in Chest X-ray Images
    Guan, Qingji
    Huang, Yaping
    Luo, Yawei
    Liu, Ping
    Xu, Mingliang
    Yang, Yi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2476 - 2487
  • [6] Multi-label chest X-ray image classification via category-wise residual attention learning
    Guan, Qingji
    Huang, Yaping
    [J]. PATTERN RECOGNITION LETTERS, 2020, 130 : 259 - 266
  • [7] Irvin J, 2019, AAAI CONF ARTIF INTE, P590
  • [8] Boosted Cascaded Convnets for Multilabel Classification of Thoracic Diseases in Chest Radiographs
    Kumar, Pulkit
    Grewal, Monika
    Srivastava, Muktabh Mayank
    [J]. IMAGE ANALYSIS AND RECOGNITION (ICIAR 2018), 2018, 10882 : 546 - 552
  • [9] Fundus Image Screening for Diabetic Retinopathy
    Li Jiayu
    Chen Minghui
    Yang Ruijun
    Ma Wenfei
    Lai Xiangling
    Huang Duowen
    Liu Duxin
    Ma Xinhong
    Shen Yue
    [J]. CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2022, 49 (11):
  • [10] Liao R, 2017, AAAI CONF ARTIF INTE, P4168