Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge

被引:330
作者
Murphy, Keelin [2 ]
van Ginneken, Bram [1 ,2 ]
Reinhardt, Joseph M. [3 ]
Kabus, Sven [4 ]
Ding, Kai [3 ]
Deng, Xiang
Cao, Kunlin [5 ]
Du, Kaifang [3 ]
Christensen, Gary E. [5 ]
Garcia, Vincent [6 ]
Vercauteren, Tom [7 ]
Ayache, Nicholas [6 ]
Commowick, Olivier [8 ]
Malandain, Gregoire [6 ]
Glocker, Ben [9 ]
Paragios, Nikos [10 ,11 ]
Navab, Nassir [9 ]
Gorbunova, Vladlena [12 ]
Sporring, Jon [12 ]
de Bruijne, Marleen [12 ,13 ]
Han, Xiao [14 ]
Heinrich, Mattias P. [15 ,16 ]
Schnabel, Julia A. [15 ]
Jenkinson, Mark [16 ]
Lorenz, Cristian [4 ]
Modat, Marc [17 ]
McClelland, Jamie R. [17 ]
Ourselin, Sebastien [17 ]
Muenzing, Sascha E. A. [2 ]
Viergever, Max A. [2 ]
De Nigris, Dante [18 ]
Collins, D. Louis [19 ]
Arbel, Tal [18 ]
Peroni, Marta [20 ,21 ,22 ]
Li, Rui [20 ]
Sharp, Gregory C. [20 ]
Schmidt-Richberg, Alexander [23 ]
Ehrhardt, Jan [23 ]
Werner, Rene [23 ]
Smeets, Dirk [24 ]
Loeckx, Dirk [24 ]
Song, Gang [25 ]
Tustison, Nicholas [26 ]
Avants, Brian [25 ]
Gee, James C. [25 ]
Staring, Marius [27 ]
Klein, Stefan [13 ]
Stoel, Berend C. [27 ]
Urschler, Martin [28 ,29 ]
Werlberger, Manuel [28 ]
机构
[1] Radboud Univ Nijmegen, Med Ctr, Dept Radiol, NL-6500 HB Nijmegen, Netherlands
[2] Univ Med Ctr, Image Sci Inst, NL-3584 CX Utrecht, Netherlands
[3] Univ Iowa, Dept Biomed Engn, Iowa City, IA 52242 USA
[4] Philips Res Labs, D-22335 Hamburg, Germany
[5] Univ Iowa, Dept Elect & Comp Engn, Iowa City, IA 52242 USA
[6] INRIA Sophia Antipolis Mediterranee, F-06902 Sophia Antipolis, France
[7] Mauna Kea Technol, F-75010 Paris, France
[8] INRIA Rennes Bretagne Atlantique, Rennes, France
[9] Tech Univ Munich, D-85748 Garching, Germany
[10] INRIA Saclay Ile de France, F-91893 Orsay, France
[11] Ecole Cent Paris, Lab MAS, F-92295 Chatenay Malabry, France
[12] Univ Copenhagen, Dept Comp Sci, DK-2100 Copenhagen, Denmark
[13] Erasmus MC, Biomed Imaging Grp Rotterdam, NL-3000 CA Rotterdam, Netherlands
[14] Elekta Inc, CMS Software, Maryland Hts, MO 63043 USA
[15] Univ Oxford, Inst Biomed Engn, Dept Engn Sci, Oxford OX3 7DQ, England
[16] Univ Oxford, Ctr Funct MRI Brain, Oxford OX3 9DU, England
[17] UCL, Ctr Med Image Comp, London WC1E 6BT, England
[18] McGill Univ, Ctr Intelligent Machines, Montreal, PQ H3A 2T5, Canada
[19] McGill Univ, Dept Biomed Engn, Montreal, PQ H3A 2T5, Canada
[20] Massachusetts Gen Hosp, Boston, MA 02114 USA
[21] Politecn Milan, I-20133 Milan, Italy
[22] MIT, Cambridge, MA 02139 USA
[23] Univ Lubeck, Inst Med Informat, D-23538 Lubeck, Germany
[24] Univ Hosp Gasthuisberg, KU Leuven, Fac Engn, ESAT PSI,Med Imaging Res Ctr, B-3000 Louvain, Belgium
[25] Univ Penn, Sch Med, PICSL, Dept Radiol, Philadelphia, PA 19104 USA
[26] Univ Virginia, Dept Radiol & Med Imaging, Charlottesville, VA 22908 USA
[27] Leiden Univ, Med Ctr, Div Image Proc, Dept Radiol, NL-2300 RC Leiden, Netherlands
[28] Graz Univ Technol, Inst Comp Graph & Vis, A-8010 Graz, Austria
[29] Ludwig Boltzmann Inst Clin Forens Imaging, A-8010 Graz, Austria
[30] Univ Lyon 1, CREATIS, CNRS UMR5220, Inserm U1044,INSA Lyon,Ctr Leon Berard, F-69000 Lyon, France
基金
英国工程与自然科学研究理事会;
关键词
Chest; computed tomography; evaluation; registration; DEFORMABLE IMAGE REGISTRATION; LUNG MOTION; MULTI-INSTITUTION; MEDICAL IMAGES; ACCURACY; ALGORITHMS; QUANTIFICATION; SEGMENTATION; VALIDATION; FRAMEWORK;
D O I
10.1109/TMI.2011.2158349
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intrapatient thoracic CT image pairs. Evaluation of nonrigid registration techniques is a nontrivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This paper details the organization of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.
引用
收藏
页码:1901 / 1920
页数:20
相关论文
共 63 条
[1]  
[Anonymous], P MED IM AN CLIN GRA
[2]  
[Anonymous], 2010, 13 WORKSH EV METH PU
[3]  
[Anonymous], 2007, 15 INT C USE COMP RA
[4]   A reproducible evaluation of ANTs similarity metric performance in brain image registration [J].
Avants, Brian B. ;
Tustison, Nicholas J. ;
Song, Gang ;
Cook, Philip A. ;
Klein, Arno ;
Gee, James C. .
NEUROIMAGE, 2011, 54 (03) :2033-2044
[5]   4D-CT lung motion estimation with deformable registration: Quantification of motion nonlinearity and hysteresis [J].
Boldea, Vlad ;
Sharp, Gregory C. ;
Jiang, Steve B. ;
Sarrut, David .
MEDICAL PHYSICS, 2008, 35 (03) :1008-1018
[6]   RESULTS OF A MULTI-INSTITUTION DEFORMABLE REGISTRATION ACCURACY STUDY (MIDRAS) [J].
Brock, Kristy K. .
INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2010, 76 (02) :583-596
[7]   A SURVEY OF IMAGE REGISTRATION TECHNIQUES [J].
BROWN, LG .
COMPUTING SURVEYS, 1992, 24 (04) :325-376
[8]  
CAO K, 2010, LECT NOTES COMPUTER, V6204
[9]  
Cao K., 2010, GRAND CHALLENGES MED, P43
[10]   A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets [J].
Castillo, Richard ;
Castillo, Edward ;
Guerra, Rudy ;
Johnson, Valen E. ;
McPhail, Travis ;
Garg, Amit K. ;
Guerrero, Thomas .
PHYSICS IN MEDICINE AND BIOLOGY, 2009, 54 (07) :1849-1870