Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study

被引:217
作者
van Ginneken, Bram [1 ,2 ]
Armato, Samuel G., III [3 ]
de Hoop, Bartjan [4 ]
van Amelsvoort-van de Vorst, Saskia [4 ]
Duindam, Thomas [1 ]
Niemeijer, Meindert [1 ]
Murphy, Keelin [1 ]
Schilham, Arnold [1 ]
Retico, Alessandra [5 ]
Fantacci, Maria Evelina [5 ,6 ]
Camarlinghi, Niccolo [5 ,6 ]
Bagagli, Francesco [5 ,6 ]
Gori, Ilaria [5 ,7 ]
Hara, Takeshi [8 ]
Fujita, Hiroshi [8 ]
Gargano, Gianfranco [9 ,10 ]
Bellotti, Roberto [9 ,10 ]
Tangaro, Sabina [10 ]
Bolanos, Lourdes [11 ]
De Carlo, Francesco [10 ]
Cerello, Piergiorgio [11 ]
Cheran, Sorin Cristian [11 ]
Lopez Torres, Ernesto
Prokop, Mathias [2 ,4 ]
机构
[1] Univ Med Ctr Utrecht, Image Sci Inst, NL-3584 CX Utrecht, Netherlands
[2] Radboud Univ Nijmegen, Med Ctr, Dept Radiol, Nijmegen, Netherlands
[3] Univ Chicago, Dept Radiol, Chicago, IL 60637 USA
[4] Univ Med Ctr Utrecht, Dept Radiol, NL-3584 CX Utrecht, Netherlands
[5] Ist Nazl Fis Nucl, Sez Pisa, Pisa, Italy
[6] Univ Pisa, Dipartimento Fis, Pisa, Italy
[7] Bracco Imaging SpA, Milan, Italy
[8] Gifu Univ, Dept Intelligent Image Informat, Grad Sch Med, Gifu, Japan
[9] Univ Bari, Dipartimento Interateneo M Merlin, I-70121 Bari, Italy
[10] Ist Nazl Fis Nucl, Sez Bari, Bari, Italy
[11] Ist Nazl Fis Nucl, Sez Torino, Turin, Italy
关键词
Computer-aided detection; Computed tomography; Lung nodules; Lung cancer; SELECTIVE ENHANCEMENT FILTERS; MAXIMUM-INTENSITY-PROJECTION; IMAGE-DATABASE-CONSORTIUM; THIN-SECTION CT; LUNG NODULES; AUTOMATED DETECTION; CAD-SYSTEM; CHEST CT; CANCER; SEGMENTATION;
D O I
10.1016/j.media.2010.05.005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Numerous publications and commercial systems are available that deal with automatic detection of pulmonary nodules in thoracic computed tomography scans, but a comparative study where many systems are applied to the same data set has not yet been performed. This paper introduces ANODE09 (http://anode09.isi.uu.nl), a database of 55 scans from a lung cancer screening program and a web-based framework for objective evaluation of nodule detection algorithms. Any team can upload results to facilitate benchmarking. The performance of six algorithms for which results are available are compared; five from academic groups and one commercially available system. A method to combine the output of multiple systems is proposed. Results show a substantial performance difference between algorithms, and demonstrate that combining the output of algorithms leads to marked performance improvements. (c) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:707 / 722
页数:16
相关论文
共 70 条
[1]   Computerized scheme for automated detection of lung nodules in low-dose computed tomography images for lung cancer screening [J].
Arimura, H ;
Katsuragawa, S ;
Suzuki, K ;
Li, F ;
Shiraishi, J ;
Sone, S ;
Doi, K .
ACADEMIC RADIOLOGY, 2004, 11 (06) :617-629
[2]   The Lung Image Database Consortium (LIDC): An evaluation of radiologist variability in the identification of lung nodules on CT scans [J].
Armato, Samuel G., III ;
McNitt-Gray, Michael F. ;
Reeves, Anthony P. ;
Meyer, Charles R. ;
McLennan, Geoffrey ;
Aberle, Denise R. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
Hoffman, Eric A. ;
Henschke, Claudia I. ;
Roberts, Rachael Y. ;
Brown, Matthew S. ;
Engelmann, Roger M. ;
Pais, Richard C. ;
Piker, Christopher W. ;
Qing, David ;
Kocherginsky, Masha ;
Croft, Barbara Y. ;
Clarke, Laurence P. .
ACADEMIC RADIOLOGY, 2007, 14 (11) :1409-1421
[3]   Assessment of Radiologist Performance in the Detection of Lung Nodules: Dependence on the Definition of "Truth" [J].
Armato, Samuel G., III ;
Roberts, Rachael Y. ;
Kocherginsky, Masha ;
Aberle, Denise R. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
McLennan, Geoffrey ;
McNitt-Gray, Michael F. ;
Meyer, Charles R. ;
Reeves, Anthony P. ;
Caligiuri, Philip ;
Quint, Leslie E. ;
Sundaram, Baskaran ;
Croft, Barbara Y. ;
Clarke, Laurence P. .
ACADEMIC RADIOLOGY, 2009, 16 (01) :28-38
[4]   Lung image database consortium: Developing a resource for the medical imaging research community [J].
Armato, SG ;
McLennan, G ;
McNitt-Gray, MF ;
Meyer, CR ;
Yankelevitz, D ;
Aberle, DR ;
Henschke, CI ;
Hoffman, EA ;
Kazerooni, EA ;
MacMahon, H ;
Reeves, AP ;
Croft, BY ;
Clarke, LP .
RADIOLOGY, 2004, 232 (03) :739-748
[5]   Lung cancer: Performance of automated lung nodule detection applied to cancers missed in a CT screening program [J].
Armato, SG ;
Li, F ;
Giger, ML ;
MacMahon, H ;
Sone, S ;
Doi, K .
RADIOLOGY, 2002, 225 (03) :685-692
[6]   Automated detection of lung nodules in CT scans: Preliminary results [J].
Armato, SG ;
Giger, ML ;
MacMahon, H .
MEDICAL PHYSICS, 2001, 28 (08) :1552-1561
[7]   Glossary of terms for CT of the lungs: Recommendations of the Nomenclature Committee of the Fleischner Society [J].
Austin, JHM ;
Muller, NL ;
Friedman, PJ ;
Hansell, DM ;
Naidich, DP ;
RemyJardin, M ;
Webb, WR ;
Zerhouni, EA .
RADIOLOGY, 1996, 200 (02) :327-331
[8]   Pulmonary nodules: Automated detection on CT images with morphologic matching algorithm preliminary results [J].
Bae, KT ;
Kim, JS ;
Na, YH ;
Kim, KG ;
Kim, JH .
RADIOLOGY, 2005, 236 (01) :286-294
[9]   A CAD system for nodule detection in low-dose lung CTs based on region growing and a new active contour model [J].
Bellotti, R. ;
De Carlo, F. ;
Gargano, G. ;
Tangaro, S. ;
Cascio, D. ;
Catanzariti, E. ;
Cerello, P. ;
Cheran, S. C. ;
Delogu, P. ;
De Mitri, I. ;
Fulcheri, C. ;
Grosso, D. ;
Retico, A. ;
Squarcia, S. ;
Tommasi, E. ;
Golosio, Bruno .
MEDICAL PHYSICS, 2007, 34 (12) :4901-4910
[10]   Distributed medical images analysis on a Grid infrastructure [J].
Bellotti, R. ;
Cerello, P. ;
Tangaro, S. ;
Bevilacqua, V. ;
Castellano, M. ;
Mastronardi, G. ;
De Carlo, F. ;
Bagnasco, S. ;
Bottigli, U. ;
Cataldo, R. ;
Catanzariti, E. ;
Cheran, S. C. ;
Delogu, P. ;
De Mitri, I. ;
De Nunzio, G. ;
Fantacci, M. E. ;
Fauci, F. ;
Gargano, G. ;
Golosio, B. ;
Indovina, P. L. ;
Lauria, A. ;
Lopez-Torres, E. ;
Magro, R. ;
Masala, G. L. ;
Massafra, R. ;
Oliva, P. ;
Martinez, A. Preite ;
Quarta, M. ;
Raso, G. ;
Retico, A. ;
Sitta, M. ;
Stumbo, S. ;
Tata, A. ;
Squarcia, S. ;
Schenone, A. ;
Molinari, E. ;
Canesi, B. .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2007, 23 (03) :475-484