The Lung Image Database Consortium, (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT Scans

被引:1709
作者
Armato, Samuel G., III [1 ]
McLennan, Geoffrey [2 ]
Bidaut, Luc
McNitt-Gray, Michael F. [3 ]
Meyer, Charles R. [4 ]
Reeves, Anthony P. [5 ]
Zhao, Binsheng [6 ]
Aberle, Denise R. [3 ]
Henschke, Claudia I. [7 ,31 ]
Hoffman, Eric A. [8 ]
Kazerooni, Ella A. [9 ]
MacMahon, Heber [1 ]
van Beek, Edwin J. R. [8 ]
Yankelevitz, David [7 ]
Biancardi, Alberto M. [5 ]
Bland, Peyton H. [10 ]
Brown, Matthew S. [3 ]
Engelmann, Roger M. [1 ]
Laderach, Gary E. [10 ]
Max, Daniel [7 ]
Pais, Richard C. [3 ]
Qing, David P-Y [3 ]
Roberts, Rachael Y. [1 ]
Smith, Amanda R. [8 ]
Starkey, Adam
Batra, Poonam [3 ]
Caligiuri, Philip [1 ]
Farooqi, Ali [7 ]
Gladish, Gregory W. [11 ]
Jude, C. Matilda [3 ]
Munden, Reginald F. [12 ]
Petkovska, Iva [3 ]
Quint, Leslie E.
Schwartz, Lawrence H. [13 ]
Sundaram, Baskaran [14 ]
Dodd, Lori E.
Fenimore, Charles [15 ]
Gur, David [16 ]
Petrick, Nicholas [17 ]
Freymann, John [18 ]
Kirby, Justin [18 ]
Hughes, Brian [19 ]
Casteele, Alessi Vande [20 ]
Gupte, Sangeeta [21 ]
Sallam, Maha [22 ]
Heath, Michael D. [23 ]
Kuhn, Michael H. [24 ]
Dharaiya, Ekta [25 ]
Burns, Richard [26 ]
Fryd, David S. [26 ]
机构
[1] Univ Chicago, Dept Radiol, Chicago, IL 60637 USA
[2] Univ Iowa, Carver Coll Med, Dept Internal Med, Div Pulm, Iowa City, IA 52242 USA
[3] Univ Calif Los Angeles, David Geffen Sch Med, Dept Radiol Sci, Los Angeles, CA 90024 USA
[4] Univ Michigan, Dept Radiol, Sch Med, Ann Arbor, MI 48109 USA
[5] Cornell Univ, Sch Elect & Comp Engn, Ithaca, NY 14853 USA
[6] Mem Sloan Kettering Canc Ctr, Dept Med Phys, New York, NY 10065 USA
[7] Mt Sinai Sch Med, Dept Radiol, New York, NY 10029 USA
[8] Univ Iowa, Carver Coll Med, Dept Radiol, Iowa City, IA 52242 USA
[9] Univ Michigan Hlth Syst, Dept Radiol, Cardiovasc Ctr 5482, Ann Arbor, MI 48109 USA
[10] Univ Michigan, Dept Radiol, BSRB A502, Ann Arbor, MI 48109 USA
[11] Univ Texas MD Anderson Canc Ctr, Dept Diagnost Radiol, Unit 1478, Houston, TX 77030 USA
[12] Univ Texas MD Anderson Canc Ctr, Dept Diagnost Imaging, Unit 1478, Houston, TX 77030 USA
[13] Mem Sloan Kettering Canc Ctr, Dept Radiol, New York, NY 10065 USA
[14] Univ Michigan Hlth Syst, Dept Radiol, CVC 5481, Ann Arbor, MI 48109 USA
[15] NIST, Informat Access Div, Gaithersburg, MD 20899 USA
[16] Univ Pittsburgh, Dept Radiol, Pittsburgh, PA 15213 USA
[17] US FDA, Silver Spring, MD 20993 USA
[18] SAIC Frederick Inc, Bethesda, MD 20892 USA
[19] TerpSys, Rockville, MD 20852 USA
[20] Agfa HealthCare NV, B-2640 Mortsel, Belgium
[21] FUJIFILM Med Syst USA Inc, Stamford, CT 06902 USA
[22] iCAD Inc, Nashua, NH 03062 USA
[23] Carestream Hlth Inc, Rochester, NY 14615 USA
[24] Philips Med Syst DMC GmbH, D-22315 Hamburg, Germany
[25] Philips Healthcare, Highland Hts, OH 44143 USA
[26] Riverain Med, Miamisburg, OH 45342 USA
[27] Siemens Med Solut USA Inc, Malvern, PA 19355 USA
[28] GE Healthcare, Waukesha, WI 53188 USA
[29] Med Imaging & Technol Alliance, Arlington, VA 22209 USA
[30] NCI, Canc Imaging Program, Bethesda, MD 20892 USA
[31] Weill Cornell Med Coll, Dept Radiol, New York, NY USA
基金
美国国家卫生研究院;
关键词
lung nodule; computed tomography (CT); thoracic imaging; interobserver variability; computer-aided diagnosis (CAD); COMPUTED-TOMOGRAPHY SCANS; PULMONARY NODULES; CANCER; CAD; DISCRIMINATION; COLONOGRAPHY; RADIOLOGISTS; VARIABILITY; PERFORMANCE; SELECTION;
D O I
10.1118/1.3528204
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: The development of computer-aided diagnostic (CAD) methods for lung nodule detection, classification, and quantitative assessment can be facilitated through a well-characterized repository of computed tomography (CT) scans. The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI) completed such a database, establishing a publicly available reference for the medical imaging research community. Initiated by the National Cancer Institute (NCI), further advanced by the Foundation for the National Institutes of Health (FNIH), and accompanied by the Food and Drug Administration (FDA) through active participation, this public-private partnership demonstrates the success of a consortium founded on a consensus-based process. Methods: Seven academic centers and eight medical imaging companies collaborated to identify, address, and resolve challenging organizational, technical, and clinical issues to provide a solid foundation for a robust database. The LIDC/IDRI Database contains 1018 cases, each of which includes images from a clinical thoracic CT scan and an associated XML file that records the results of a two-phase image annotation process performed by four experienced thoracic radiologists. In the initial blinded-read phase, each radiologist independently reviewed each CT scan and marked lesions belonging to one of three categories ("nodule >= 3 mm," "nodule < 3 mm," and "non-nodule >= 3 mm"). In the subsequent unblinded-read phase, each radiologist independently reviewed their own marks along with the anonymized marks of the three other radiologists to render a final opinion. The goal of this process was to identify as completely as possible all lung nodules in each CT scan without requiring forced consensus. Results: The Database contains 7371 lesions marked "nodule" by at least one radiologist. 2669 of these lesions were marked "nodule >= 3 mm" by at least one radiologist, of which 928 (34.7%) received such marks from all four radiologists. These 2669 lesions include nodule outlines and subjective nodule characteristic ratings. Conclusions: The LIDC/IDRI Database is expected to provide an essential medical imaging research resource to spur CAD development, validation, and dissemination in clinical practice. [DOI: 10.1118/1.3528204]
引用
收藏
页码:915 / 931
页数:17
相关论文
共 45 条
[1]  
[Anonymous], 2002, FED REGISTER, V57, P53182
[2]  
[Anonymous], 2000, P DIG MAMM
[3]   The Reference Image Database to Evaluate Response to therapy in lung cancer (RIDER) project: A resource for the development of change-analysis software [J].
Armato, S. G., III ;
Meyer, C. R. ;
McNitt-Gray, M. F. ;
McLennan, G. ;
Reeves, A. P. ;
Croft, B. Y. ;
Clarke, L. P. .
CLINICAL PHARMACOLOGY & THERAPEUTICS, 2008, 84 (04) :448-456
[4]   The lung image database consortium (LIDC): Ensuring the integrity of expert-defined "truth" [J].
Armato, Samuel G., III ;
Roberts, Rachael Y. ;
McNitt-Gray, Michael F. ;
Meyer, Charles R. ;
Reeves, Anthony P. ;
McLennan, Geoffrey ;
Engelmann, Roger M. ;
Bland, Peyton H. ;
Aberle, Denise R. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
Croft, Barbara Y. ;
Clarke, Laurence P. .
ACADEMIC RADIOLOGY, 2007, 14 (12) :1455-1463
[5]   The Lung Image Database Consortium (LIDC): An evaluation of radiologist variability in the identification of lung nodules on CT scans [J].
Armato, Samuel G., III ;
McNitt-Gray, Michael F. ;
Reeves, Anthony P. ;
Meyer, Charles R. ;
McLennan, Geoffrey ;
Aberle, Denise R. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
Hoffman, Eric A. ;
Henschke, Claudia I. ;
Roberts, Rachael Y. ;
Brown, Matthew S. ;
Engelmann, Roger M. ;
Pais, Richard C. ;
Piker, Christopher W. ;
Qing, David ;
Kocherginsky, Masha ;
Croft, Barbara Y. ;
Clarke, Laurence P. .
ACADEMIC RADIOLOGY, 2007, 14 (11) :1409-1421
[6]   Assessment of Radiologist Performance in the Detection of Lung Nodules: Dependence on the Definition of "Truth" [J].
Armato, Samuel G., III ;
Roberts, Rachael Y. ;
Kocherginsky, Masha ;
Aberle, Denise R. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
McLennan, Geoffrey ;
McNitt-Gray, Michael F. ;
Meyer, Charles R. ;
Reeves, Anthony P. ;
Caligiuri, Philip ;
Quint, Leslie E. ;
Sundaram, Baskaran ;
Croft, Barbara Y. ;
Clarke, Laurence P. .
ACADEMIC RADIOLOGY, 2009, 16 (01) :28-38
[7]   Lung image database consortium: Developing a resource for the medical imaging research community [J].
Armato, SG ;
McLennan, G ;
McNitt-Gray, MF ;
Meyer, CR ;
Yankelevitz, D ;
Aberle, DR ;
Henschke, CI ;
Hoffman, EA ;
Kazerooni, EA ;
MacMahon, H ;
Reeves, AP ;
Croft, BY ;
Clarke, LP .
RADIOLOGY, 2004, 232 (03) :739-748
[8]   Glossary of terms for CT of the lungs: Recommendations of the Nomenclature Committee of the Fleischner Society [J].
Austin, JHM ;
Muller, NL ;
Friedman, PJ ;
Hansell, DM ;
Naidich, DP ;
RemyJardin, M ;
Webb, WR ;
Zerhouni, EA .
RADIOLOGY, 1996, 200 (02) :327-331
[9]   A comparison of ground truth estimation methods [J].
Biancardi, Alberto M. ;
Jirapatnakul, Artit C. ;
Reeves, Anthony P. .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2010, 5 (03) :295-305
[10]  
Bowyer K, 1996, INT CONGR SER, V1119, P431