Multi-view Convolutional Recurrent Neural Networks for Lung Cancer Nodule Identification

被引:35
作者
Abid, Mian Muhammad Naeem [1 ]
Zia, Tehseen [1 ]
Ghafoor, Mubeen [1 ]
Windridge, David [2 ]
机构
[1] COMSATS Univ Islamabad CUI, Dept Comp Sci, Islamabad, Pakistan
[2] Middlesex Univ, Dept Comp Sci, London, England
关键词
Lung Cancer; Nodule Detection; CT Scan Images; Convolutional Neural Networks; Recurrent Neural Networks; Long Short Term Memory; FALSE-POSITIVE REDUCTION; PULMONARY NODULES; AUTOMATIC DETECTION; CLASSIFICATION; CNNS;
D O I
10.1016/j.neucom.2020.06.144
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Screening via low-dose Computer Tomography (CT) has been shown to reduce lung cancer mortality rates by at least 20%. However, the assessment of large numbers of CT scans by radiologists is cost intensive, and potentially produces varying and inconsistent results for differing radiologists (and also for temporally-separated assessments by the same radiologist). To overcome these challenges, computer aided diagnosis systems based on deep learning methods have proved effective in automatic detection and classification of lung cancer. Latterly, interest has focused on the full utilization of the 3D information in CT scans using 3D-CNNs and related approaches. However, such approaches do not intrinsically correlate size and shape information between slices. In this work, an innovative approach Multi-view Convolutional Recurrent Neural Network (MV-CRecNet) is proposed that exploits shape, size and cross-slice variations while learning to identify lung cancer nodules from CT scans. The multiple-views that are passed to the model ensure better generalization and the learning of robust features. We evaluate the proposed MV-CRecNet model on the reference Lung Image Database Consortium and Image Database Resource Initiative and Early Lung Cancer Action Program datasets; six evaluation metrics are applied to eleven comparison models for testing. Results demonstrate that proposed methodology outperforms all of the models against all of the evaluation metrics. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:299 / 311
页数:13
相关论文
共 44 条
[1]  
[Anonymous], 2019, PROC SPIE, DOI DOI 10.1117/12.2520333
[2]   The Lung Image Database Consortium, (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT Scans [J].
Armato, Samuel G., III ;
McLennan, Geoffrey ;
Bidaut, Luc ;
McNitt-Gray, Michael F. ;
Meyer, Charles R. ;
Reeves, Anthony P. ;
Zhao, Binsheng ;
Aberle, Denise R. ;
Henschke, Claudia I. ;
Hoffman, Eric A. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
Biancardi, Alberto M. ;
Bland, Peyton H. ;
Brown, Matthew S. ;
Engelmann, Roger M. ;
Laderach, Gary E. ;
Max, Daniel ;
Pais, Richard C. ;
Qing, David P-Y ;
Roberts, Rachael Y. ;
Smith, Amanda R. ;
Starkey, Adam ;
Batra, Poonam ;
Caligiuri, Philip ;
Farooqi, Ali ;
Gladish, Gregory W. ;
Jude, C. Matilda ;
Munden, Reginald F. ;
Petkovska, Iva ;
Quint, Leslie E. ;
Schwartz, Lawrence H. ;
Sundaram, Baskaran ;
Dodd, Lori E. ;
Fenimore, Charles ;
Gur, David ;
Petrick, Nicholas ;
Freymann, John ;
Kirby, Justin ;
Hughes, Brian ;
Casteele, Alessi Vande ;
Gupte, Sangeeta ;
Sallam, Maha ;
Heath, Michael D. ;
Kuhn, Michael H. ;
Dharaiya, Ekta ;
Burns, Richard ;
Fryd, David S. .
MEDICAL PHYSICS, 2011, 38 (02) :915-931
[3]   Computerized detection of pulmonary nodules on CT scans [J].
Armato, SG ;
Giger, ML ;
Moran, CJ ;
Blackburn, JT ;
Doi, K ;
MacMahon, H .
RADIOGRAPHICS, 1999, 19 (05) :1303-1311
[4]   Towards automatic pulmonary nodule management in lung cancer screening with deep learning [J].
Ciompi, Francesco ;
Chung, Kaman ;
van Riel, Sarah J. ;
Setio, Arnaud Arindra Adiyoso ;
Gerke, Paul K. ;
Jacobs, Colin ;
Scholten, Ernst Th. ;
Schaefer-Prokop, Cornelia ;
Wille, Mathilde M. W. ;
Marchiano, Alfonso ;
Pastorino, Ugo ;
Prokop, Mathias ;
van Ginneken, Bram .
SCIENTIFIC REPORTS, 2017, 7
[5]   Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection [J].
Dou, Qi ;
Chen, Hao ;
Yu, Lequan ;
Qin, Jing ;
Heng, Pheng-Ann .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (07) :1558-1567
[6]   Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 [J].
Ferlay, Jacques ;
Soerjomataram, Isabelle ;
Dikshit, Rajesh ;
Eser, Sultan ;
Mathers, Colin ;
Rebelo, Marise ;
Parkin, Donald Maxwell ;
Forman, David ;
Bray, Freddie .
INTERNATIONAL JOURNAL OF CANCER, 2015, 136 (05) :E359-E386
[7]   Computer-aided detection (CADe) and diagnosis (CADx) system for lung cancer with likelihood of malignancy [J].
Firmino, Macedo ;
Angelo, Giovani ;
Morais, Higor ;
Dantas, Marcel R. ;
Valentim, Ricardo .
BIOMEDICAL ENGINEERING ONLINE, 2016, 15
[8]  
Glorot X., 2011, JMLR WORKSHOP C P, P315
[9]   3D deep learning for detecting pulmonary nodules in CT scans [J].
Gruetzemacher, Ross ;
Gupta, Ashish ;
Paradice, David .
JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2018, 25 (10) :1301-1310
[10]   Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs [J].
Gu, Yu ;
Lu, Xiaoqi ;
Yang, Lidong ;
Zhang, Baohua ;
Yu, Dahua ;
Zhao, Ying ;
Gao, Lixin ;
Wu, Liang ;
Zhou, Tao .
COMPUTERS IN BIOLOGY AND MEDICINE, 2018, 103 :220-231