SANet: A Slice-Aware Network for Pulmonary Nodule Detection

被引:90
作者
Mei, Jie [1 ]
Cheng, Ming-Ming [1 ]
Xu, Gang [1 ]
Wan, Lan-Ruo [2 ]
Zhang, Huan [2 ]
机构
[1] Nankai Univ, Coll Comp Sci, TKLNDST, Tianjin 300350, Peoples R China
[2] InferVision, Beijing 100025, Peoples R China
关键词
Lung; Three-dimensional displays; Computed tomography; Two dimensional displays; Feature extraction; Proposals; Object detection; Pulmonary nodule detection; nodule dataset; slice grouped non-local; false positive reduction; FALSE-POSITIVE REDUCTION; LUNG-CANCER; AUTOMATIC DETECTION; DIAGNOSIS; CLASSIFICATION; VALIDATION; SYSTEM; ALGORITHMS; IMAGES; SCANS;
D O I
10.1109/TPAMI.2021.3065086
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Lung cancer is the most common cause of cancer death worldwide. A timely diagnosis of the pulmonary nodules makes it possible to detect lung cancer in the early stage, and thoracic computed tomography (CT) provides a convenient way to diagnose nodules. However, it is hard even for experienced doctors to distinguish them from the massive CT slices. The currently existing nodule datasets are limited in both scale and category, which is insufficient and greatly restricts its applications. In this paper, we collect the largest and most diverse dataset named PN9 for pulmonary nodule detection by far. Specifically, it contains 8,798 CT scans and 40,439 annotated nodules from 9 common classes. We further propose a slice-aware network (SANet) for pulmonary nodule detection. A slice grouped non-local (SGNL) module is developed to capture long-range dependencies among any positions and any channels of one slice group in the feature map. And we introduce a 3D region proposal network to generate pulmonary nodule candidates with high sensitivity, while this detection stage usually comes with many false positives. Subsequently, a false positive reduction module (FPR) is proposed by using the multi-scale feature maps. To verify the performance of SANet and the significance of PN9, we perform extensive experiments compared with several state-of-the-art 2D CNN-based and 3D CNN-based detection methods. Promising evaluation results on PN9 prove the effectiveness of our proposed SANet. The dataset and source code is available at https://mmcheng.net/SANet/.
引用
收藏
页码:4374 / 4387
页数:14
相关论文
共 71 条
[31]   ACR-STR Practice Parameter for the Performance and Reporting of Lung Cancer Screening Thoracic Computed Tomography (CT) [J].
Kazerooni, Ella A. ;
Austin, John H. M. ;
Black, William C. ;
Dyer, Debra S. ;
Hazelton, Todd R. ;
Leung, Ann N. ;
McNitt-Gray, Michael F. ;
Munden, Reginald F. ;
Pipavath, Sudhakar .
JOURNAL OF THORACIC IMAGING, 2014, 29 (05) :310-316
[32]   Multi-scale gradual integration CNN for false positive reduction in pulmonary nodule detection [J].
Kim, Bum-Chae ;
Yoon, Jee Seok ;
Choi, Jun-Sik ;
Suk, Heung-Il .
NEURAL NETWORKS, 2019, 115 :1-10
[33]  
Li YM, 2020, I S BIOMED IMAGING, P1866, DOI [10.1109/ISBI45749.2020.9098317, 10.1109/isbi45749.2020.9098317]
[34]   Evaluate the Malignancy of Pulmonary Nodules Using the 3-D Deep Leaky Noisy-OR Network [J].
Liao, Fangzhou ;
Liang, Ming ;
Li, Zhe ;
Hu, Xiaolin ;
Song, Sen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (11) :3484-3495
[35]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2999-3007
[36]   Bilinear CNN Models for Fine-grained Visual Recognition [J].
Lin, Tsung-Yu ;
RoyChowdhury, Aruni ;
Maji, Subhransu .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1449-1457
[37]   A survey on deep learning in medical image analysis [J].
Litjens, Geert ;
Kooi, Thijs ;
Bejnordi, Babak Ehteshami ;
Setio, Arnaud Arindra Adiyoso ;
Ciompi, Francesco ;
Ghafoorian, Mohsen ;
van der Laak, Jeroen A. W. M. ;
van Ginneken, Bram ;
Sanchez, Clara I. .
MEDICAL IMAGE ANALYSIS, 2017, 42 :60-88
[38]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[39]   Large scale validation of the M5L lung CAD on heterogeneous CT datasets [J].
Lopez Torres, E. ;
Fiorina, E. ;
Pennazio, F. ;
Peroni, C. ;
Saletta, M. ;
Camarlinghi, N. ;
Fantacci, M. E. ;
Cerello, P. .
MEDICAL PHYSICS, 2015, 42 (04) :1477-1489
[40]   Guidelines for Management of Incidental Pulmonary Nodules Detected on CT Images: From the Fleischner Society 2017 [J].
MacMahon, Heber ;
Naidich, David P. ;
Goo, Jin Mo ;
Lee, Kyung Soo ;
Leung, Ann N. C. ;
Mayo, John R. ;
Mehta, Atul C. ;
Ohno, Yoshiharu ;
Powell, Charles A. ;
Prokop, Mathias ;
Rubin, Geoffrey D. ;
Schaefer-Prokop, Cornelia M. ;
Travis, William D. ;
Van Schil, Paul E. ;
Bankier, Alexander A. .
RADIOLOGY, 2017, 284 (01) :228-243