Hippocampal volume change measurement: Quantitative assessment of the reproducibility of expert manual outlining and the automated methods FreeSurfer and FIRST

被引:103
作者
Mulder, Emma R. [1 ,2 ]
de Jong, Remko A. [1 ,2 ]
Knol, Dirk L. [3 ]
van Schijndel, Ronald A. [1 ,4 ]
Cover, Keith S. [5 ]
Visser, Pieter J. [6 ]
Barkhof, Frederik [1 ,2 ]
Vrenken, Hugo [2 ,5 ]
机构
[1] Vrije Univ Amsterdam, Med Ctr, Image Anal Ctr, NL-1007 MB Amsterdam, Netherlands
[2] Vrije Univ Amsterdam, Med Ctr, Dept Radiol, NL-1007 MB Amsterdam, Netherlands
[3] Vrije Univ Amsterdam, Med Ctr, Dept Epidemiol & Biostat, NL-1007 MB Amsterdam, Netherlands
[4] Vrije Univ Amsterdam, Med Ctr, Dept Informat & Commun Technol, NL-1007 MB Amsterdam, Netherlands
[5] Vrije Univ Amsterdam, Med Ctr, Dept Phys & Med Technol, NL-1007 MB Amsterdam, Netherlands
[6] Vrije Univ Amsterdam, Med Ctr, Dept Neurol, NL-1007 MB Amsterdam, Netherlands
关键词
Hippocampus; Manual segmentation; Automatic segmentation; Magnetic resonance imaging; Mild cognitive impairment; Alzheimer's disease; TEMPORAL-LOBE EPILEPSY; BRAIN MR-IMAGES; ALZHEIMERS-DISEASE; ATROPHY RATES; FLUID REGISTRATION; SEGMENTATION; ADNI; VALIDATION; AGREEMENT; TEMPLATE;
D O I
10.1016/j.neuroimage.2014.01.058
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Background: To measure hippocampal volume change in Alzheimer's disease (AD) or mild cognitive impairment (MCI), expert manual delineation is often used because of its supposed accuracy. It has been suggested that expert outlining yields poorer reproducibility as compared to automated methods, but this has not been investigated. Aim: To determine the reproducibilities of expert manual outlining and two common automated methods for measuring hippocampal atrophy rates in healthy aging, MCI and AD. Methods: From the Alzheimer's Disease Neuroimaging Initiative (ADNI), 80 subjects were selected:20 patients with AD, 40 patients with mild cognitive impairment (MCI) and 20 healthy controls (HCs). Left and right hippocampal volume change between baseline and month-12 visit was assessed by using expert manual delineation, and by the automated software packages FreeSurfer (longitudinal processing stream) and FIRST. To assess reproducibility of the measured hippocampal volume change, both back-to-back (BTB) MPRAGE scans available for each visit were analyzed. Hippocampal volume change was expressed in mu L, and as a percentage of baseline volume. Reproducibility of the 1-year hippocampal volume change was estimated from the BTB measurements by using linear mixed model to calculate the limits of agreement (LoA) of each method, reflecting its measurement uncertainty. Using the delta method, approximate p-values were calculated for the pairwise comparisons between methods. Statistical analyses were performed both with inclusion and exclusion of visibly incorrect segmentations. Results: Visibly incorrect automated segmentation in either one or both scans of a longitudinal scan pair occurred in 7.5% of the hippocampi for FreeSurfer and in 6.9% of the hippocampi for FIRST. After excluding these failed cases, reproducibility analysis for 1-year percentage volume change yielded LoA of +/- 7.2% for FreeSurfer, +/- 9.7% for expert manual delineation, and +/- 10.0% for FIRST. Methods ranked the same for reproducibility of 1-year mu 1. volume change, with LoA of +/- 218 mu L for FreeSurfer, +/- 319 mu L for expert manual delineation, and 333 mu L for FIRST. Approximate p-values indicated that reproducibility was better for FreeSurfer than for manual or FIRST, and that manual and FIRST did not differ. Inclusion of failed automated segmentations led to worsening of reproducibility of both automated methods for 1-year raw and percentage volume change. Conclusion: Quantitative reproducibility values of 1-year microliter and percentage hippocampal volume change were roughly similar between expert manual outlining, FIRST and FreeSurfer, but FreeSurfer reproducibility was statistically significantly superior to both manual outlining and FIRST after exclusion of failed segmentations. (c) 2014 Elsevier Inc. All rights reserved.
引用
收藏
页码:169 / 181
页数:13
相关论文
共 51 条
[1]   Power Calculations for Clinical Trials in Alzheimer's Disease [J].
Ard, M. Colin ;
Edland, Steven D. .
JOURNAL OF ALZHEIMERS DISEASE, 2011, 26 :369-377
[2]   A comparison of methods for the automated calculation of volumes and atrophy rates in the hippocampus [J].
Barnes, J. ;
Foster, J. ;
Boyes, R. G. ;
Pepple, T. ;
Moore, E. K. ;
Schott, J. M. ;
Frost, C. ;
Scahill, R. I. ;
Fox, N. C. .
NEUROIMAGE, 2008, 40 (04) :1655-1671
[3]   Automatic calculation of hippocampal atrophy rates using a hippocampal template and the boundary shift integral [J].
Barnes, J. ;
Boyes, R. G. ;
Lewis, E. B. ;
Schott, J. M. ;
Frost, C. ;
Scahill, R. I. ;
Fox, N. C. .
NEUROBIOLOGY OF AGING, 2007, 28 (11) :1657-1663
[4]   Differentiating AD from aging using semiautomated measurement of hippocampal atrophy rates [J].
Barnes, J ;
Scahill, RI ;
Boyes, RG ;
Frost, C ;
Lewis, EB ;
Rossor, CL ;
Rossor, MN ;
Fox, NC .
NEUROIMAGE, 2004, 23 (02) :574-581
[5]   Agreement between methods of measurement with multiple observations per individual [J].
Bland, J. Martin ;
Altman, Douglas G. .
JOURNAL OF BIOPHARMACEUTICAL STATISTICS, 2007, 17 (04) :571-582
[6]  
Bland JM, 1999, STAT METHODS MED RES, V8, P135, DOI 10.1177/096228029900800204
[7]   STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT [J].
BLAND, JM ;
ALTMAN, DG .
LANCET, 1986, 1 (8476) :307-310
[8]   Survey of Protocols for the Manual Segmentation of the Hippocampus: Preparatory Steps Towards a Joint EADC-ADNI Harmonized Protocol [J].
Boccardi, Marina ;
Ganzola, Rossana ;
Bocchetta, Martina ;
Pievani, Michela ;
Redolfi, Alberto ;
Bartzokis, George ;
Camicioli, Richard ;
Csernansky, John G. ;
de Leon, Mony J. ;
deToledo-Morrell, Leyla ;
Killiany, Ronald J. ;
Lehericy, Stephane ;
Pantel, Johannes ;
Pruessner, Jens C. ;
Soininen, H. ;
Watson, Craig ;
Duchesne, Simon ;
Jack, Clifford R., Jr. ;
Frisoni, Giovanni B. .
JOURNAL OF ALZHEIMERS DISEASE, 2011, 26 :61-75
[9]   Gradient distortions in MRI: Characterizing and correcting for their effects on SIENA-generated measures of brain volume change [J].
Caramanos, Zografos ;
Fonov, Vladimir S. ;
Francis, Simon J. ;
Narayanan, Sridar ;
Pike, G. Bruce ;
Collins, D. Louis ;
Arnold, Douglas L. .
NEUROIMAGE, 2010, 49 (02) :1601-1611
[10]   Assessing the reproducibility of the SienaX and Siena brain atrophy measures using the ADNI back-to-back MP-RAGE MRI scans [J].
Cover, Keith S. ;
van Schijndel, Ronald A. ;
van Dijk, Bob W. ;
Redolfi, Alberto ;
Knol, Dirk L. ;
Frisoni, Giovanni B. ;
Barkhof, Frederik ;
Vrenken, Hugo .
PSYCHIATRY RESEARCH-NEUROIMAGING, 2011, 193 (03) :182-190