Interpretable and Lightweight 3-D Deep Learning Model for Automated ACL Diagnosis

被引:30
|
作者
Jeon, Young Seok [1 ,2 ]
Yoshino, Kensuke [4 ]
Hagiwara, Shigeo [4 ]
Watanabe, Atsuya [4 ]
Quek, Swee Tian [3 ]
Yoshioka, Hiroshi [5 ]
Feng, Mengling [1 ,2 ]
机构
[1] Natl Univ Singapore, Saw Swee Hock Sch Publ Hlth, Singapore 119077, Singapore
[2] Natl Univ Singapore, Inst Data Sci, Singapore 119077, Singapore
[3] Natl Univ Singapore, Dept Diagnost Imaging, Singapore 119077, Singapore
[4] Chiba Univ, Dept Orthopaed Surg, Chiba 2638522, Japan
[5] Univ Calif Irvine, Dept Radiol Sci, Irvine, CA 92697 USA
基金
新加坡国家研究基金会;
关键词
Computational modeling; Artificial intelligence; Task analysis; Biological system modeling; Solid modeling; Neural networks; Bioinformatics; ACL tear classification; interpretation; small deep neural network; 3D convolutional neural network;
D O I
10.1109/JBHI.2021.3081355
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an interpretable and lightweight 3D deep neural network model that diagnoses anterior cruciate ligament (ACL) tears from a knee MRI exam. Previous works focused primarily on achieving better diagnostic accuracy but paid less attention to practical aspects such as explainability and model size. They mainly relied on ImageNet pre-trained 2D deep neural network backbones, such as AlexNet or ResNet, which are computationally expensive. Some of them tried to interpret the models using post-inference visualization tools, such as CAM or Grad-CAM, which lack in generating accurate heatmaps. Our work addresses the two limitations by understanding the characteristics of ACL tear diagnosis. We argue that the semantic features required for classifying ACL tears are locally confined and highly homogeneous. We harness the unique characteristics of the task by incorporating: 1) attention modules and Gaussian positional encoding to reinforce the seeking of local features; 2) squeeze modules and fewer convolutional filters to reflect the homogeneity of the features. As a result, our model is interpretable: our attention modules can precisely highlight the ACL region without any location information given to them. Our model is extremely lightweight: consisting of only 43 K trainable parameters and 7.1 G of Floating-point operations per second (FLOPs), that is 225 times smaller and 91 times lesser than the previous state-of-the-art, respectively. Our model is accurate: our model outperforms the previous state-of-the-art with the average ROC-AUC of 0.983 and 0.980 on the Chiba and Stanford knee datasets, respectively.
引用
收藏
页码:2388 / 2397
页数:10
相关论文
共 50 条
  • [1] A Deep Invertible 3-D Facial Shape Model for Interpretable Genetic Syndrome Diagnosis
    Bannister, Jordan J.
    Wilms, Matthias
    Aponte, J. David
    Katz, David C.
    Klein, Ophir D.
    Bernier, Francois P. J.
    Spritz, Richard A.
    Hallgrimsson, Benedikt
    Forkert, Nils D.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (07) : 3229 - 3239
  • [2] Deep PLS: A Lightweight Deep Learning Model for Interpretable and Efficient Data Analytics
    Kong, Xiangyin
    Ge, Zhiqiang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 8923 - 8937
  • [3] Clinical Interpretable Deep Learning Model for Glaucoma Diagnosis
    Liao, WangMin
    Zou, BeiJi
    Zhao, RongChang
    Chen, YuanQiong
    He, ZhiYou
    Zhou, MengJie
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (05) : 1405 - 1412
  • [4] Lightweight Deep Learning Model for Automated COVID-19 Diagnosis from CXR Images
    Hussain, B. Zahid
    Andleeb, Ifrah
    Ansari, Mohammad Samar
    Kanwal, Nadia
    2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTING (ICOCO), 2021, : 218 - 223
  • [5] Lightweight Attention Module for Deep Learning on Classification and Segmentation of 3-D Point Clouds
    Cui, Yunhao
    An, Yi
    Sun, Wei
    Hu, Huosheng
    Song, Xueguan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [6] Monkeypox Diagnosis With Interpretable Deep Learning
    Ahsan, Md. Manjurul
    Ali, Md. Shahin
    Hassan, Md. Mehedi
    Abdullah, Tareque Abu
    Gupta, Kishor Datta
    Bagci, Ulas
    Kaushal, Chetna
    Soliman, Naglaa F.
    IEEE ACCESS, 2023, 11 : 81965 - 81980
  • [7] Automated 2-D and 3-D Left Atrial Volume Measurements Using Deep Learning
    Hu, Jieyu
    Olaisen, Sindre Hellum
    Smistad, Erik
    Dalen, Havard
    Lovstakken, Lasse
    ULTRASOUND IN MEDICINE AND BIOLOGY, 2024, 50 (01): : 47 - 56
  • [8] Deep Learning for 3-D Magnetic Inversion
    Jia, Zhuo
    Li, Yinshuo
    Wang, Yonghao
    Li, Yang
    Jin, Songbai
    Li, Yuxuan
    Lu, Wenkai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] Deep Learning for 3-D Inversion of Gravity Data
    Zhang, Lianzhi
    Zhang, Guibin
    Liu, Yao
    Fan, Zhenyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Automated Feature Document Review via Interpretable Deep Learning
    Ye, Ming
    Chen, Yuanfan
    Zhang, Xin
    He, Jinning
    Cao, Jicheng
    Liu, Dong
    Gao, Jing
    Dai, Hailiang
    Cheng, Shengyu
    2023 IEEE/ACM 45TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: COMPANION PROCEEDINGS, ICSE-COMPANION, 2023, : 351 - 354