A Robust Shape-Aware Rib Fracture Detection and Segmentation Framework With Contrastive Learning

被引:30
作者
Cao, Zheng [1 ]
Xu, Liming [1 ]
Chen, Danny Z. [2 ]
Gao, Honghao [3 ]
Wu, Jian [4 ,5 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310058, Peoples R China
[2] Univ Notre Dame, Dept Comp Sci & Engn, Notre Dame, IN 200444 USA
[3] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
[4] Zhejiang Univ, Affiliated Hosp 2, Sch Med, Hangzhou 310058, Peoples R China
[5] Zhejiang Univ, Sch Publ Hlth, Hangzhou 310058, Peoples R China
基金
中国国家自然科学基金;
关键词
Ribs; Computed tomography; Three-dimensional displays; Image segmentation; Task analysis; Training; Deep learning; Computer-aided diagnosis; rib fracture detection and segmentation; self-supervised contrastive learning; shape-aware model; ALGORITHM;
D O I
10.1109/TMM.2023.3263074
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rib fracture is a common type of thoracic skeletal trauma, and its inspections using computed tomography (CT) scans are critical for clinical evaluation and treatment planning. However, it is often challenging for radiologists to quickly and accurately detect rib fractures due to tiny objects and blurriness in large 3D CT images. Previous diagnoses for automatic rib fracture mostly relied on deep learning (DL)-based object detection, which highly depends on label quality and quantity. Moreover, general object detection methods did not take into consideration the typically elongated and oblique shapes of ribs in 3D volumes. To address these issues, we propose a shape-aware method based on DL called SA-FracNet for rib fracture detection and segmentation. First, we design a pixel-level pretext task founded on contrastive learning on massive unlabeled CT images. Second, we train the fine-tuned rib fracture detection model based on the pre-trained weights. Third, we develop a fracture shape-aware multi-task segmentation network to delineate the fracture based on the detection result. Experiments demonstrate that our proposed SA-FracNet achieves state-of-the-art rib fracture detection and segmentation performance on the public RibFrac dataset, with a detection sensitivity of 0.926 and segmentation Dice of 0.754. Test on a private dataset also validates the robustness and generalization of our SA-FracNet.
引用
收藏
页码:1584 / 1591
页数:8
相关论文
共 51 条
[1]   Enhanced reading time efficiency by use of automatically unfolded CT rib reformations in acute trauma [J].
Bier, Georg ;
Schabel, Christoph ;
Othman, Ahmed ;
Bongers, Malte N. ;
Schmehl, Joerg ;
Ditt, Hendrik ;
Nikolaou, Konstantin ;
Bamberg, Fabian ;
Notohamiprodjo, Mike .
EUROPEAN JOURNAL OF RADIOLOGY, 2015, 84 (11) :2173-2180
[2]   Full Scale Attention for Automated COVID-19 Diagnosis from CT Images [J].
Cao, Zheng ;
Mu, Cailin ;
Ying, Haochao ;
Wu, Jian .
2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, :3213-3216
[3]   Cascaded SE-ResUnet for segmentation of thoracic organs at risk [J].
Cao, Zheng ;
Yu, Bohan ;
Lei, Biwen ;
Ying, Haochao ;
Zhang, Xiao ;
Chen, Danny Z. ;
Wu, Jian .
NEUROCOMPUTING, 2021, 453 :357-368
[4]   Multi-modality fusion learning for the automatic diagnosis of optic neuropathy [J].
Cao, Zheng ;
Sun, Chuanbin ;
Wang, Wenzhe ;
Zheng, Xiangshang ;
Wu, Jian ;
Gao, Honghao .
PATTERN RECOGNITION LETTERS, 2021, 142 :58-64
[5]  
Caron M, 2020, ADV NEUR IN, V33
[6]  
Chaitanya K., 2020, Adv. Neural Inf. Process. Syst., V33, P12546
[7]  
Chen Ting, 2019, PMLR
[8]  
Chen XL, 2020, Arxiv, DOI arXiv:2003.04297
[9]   Exploring Simple Siamese Representation Learning [J].
Chen, Xinlei ;
He, Kaiming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15745-15753
[10]   An Empirical Study of Training Self-Supervised Vision Transformers [J].
Chen, Xinlei ;
Xie, Saining ;
He, Kaiming .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9620-9629