BEAN: Brain Extraction and Alignment Network for 3D Fetal Neurosonography

被引:11
作者
Moser, Felipe [1 ]
Huang, Ruobing [2 ]
Papiez, Bartlomiej W. [2 ,4 ]
Namburete, Ana I. L. [1 ,5 ]
机构
[1] Univ Oxford, Dept Comp Sci, Oxford Machine Learning Neuroimaging Lab, OMNI, Oxford, England
[2] Univ Oxford, Inst Biomed Engn, Dept Engn Sci, Oxford, England
[3] Univ Oxford, John Radcliffe Hosp, Nuffield Dept Womens & Reprod Hlth, Oxford, England
[4] Univ Oxford, Li Ka Shing Ctr Hlth Informat & Discovery, Big Data Inst, Oxford, England
[5] Univ Oxford, Wellcome Ctr Integrat Neuroimaging, Nuffield Dept Clin Neurosci, FMRIB, Oxford, England
基金
英国工程与自然科学研究理事会; 英国医学研究理事会;
关键词
Fetal brain development; Convolutional neural network; Deep learning; 3D ultrasound; Brain extraction; Brain alignment; ULTRASOUND IMAGES; AUTOMATIC FETAL; SONOGRAPHIC EXAMINATION; MRI; SEGMENTATION; LOCALIZATION; GUIDELINES; SHAPE; REGISTRATION; PERFORMANCE;
D O I
10.1016/j.neuroimage.2022.119341
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Brain extraction (masking of extra-cerebral tissues) and alignment are fundamental first steps of most neuroimage analysis pipelines. The lack of automated solutions for 3D ultrasound (US) has therefore limited its potential as a neuroimaging modality for studying fetal brain development using routinely acquired scans. In this work, we propose a convolutional neural network (CNN) that accurately and consistently aligns and extracts the fetal brain from minimally pre-processed 3D US scans. Our multi-task CNN, Brain Extraction and Alignment Network (BEAN), consists of two independent branches: 1) a fully-convolutional encoder-decoder branch for brain extraction of unaligned scans, and 2) a two-step regression-based branch for similarity alignment of the brain to a common coordinate space. BEAN was tested on 356 fetal head 3D scans spanning the gestational range of 14 to 30 weeks, significantly outperforming all current alternatives for fetal brain extraction and alignment. BEAN achieved state-of-the-art performance for both tasks, with a mean Dice Similarity Coefficient (DSC) of 0.94 for the brain extraction masks, and a mean DSC of 0.93 for the alignment of the target brain masks. The presented experimental results show that brain structures such as the thalamus, choroid plexus, cavum septum pellucidum, and Sylvian fissure, are consistently aligned throughout the dataset and remain clearly visible when the scans are averaged together.
引用
收藏
页数:18
相关论文
共 90 条
[1]  
[Anonymous], 1908, BIOMETRIKA, V6, P1
[2]  
[Anonymous], 2015, Tensor Flow: Largescale Machine Learning on Heterogeneous Systems Software
[3]   AUTOMATIC SEGMENTATION OF HEAD STRUCTURES ON FETAL MRI [J].
Anquez, Jeremie ;
Angelini, Elsa D. ;
Bloch, Isabelle .
2009 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1 AND 2, 2009, :109-112
[4]   SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound [J].
Baumgartner, Christian F. ;
Kamnitsas, Konstantinos ;
Matthew, Jacqueline ;
Fletcher, Tara P. ;
Smith, Sandra ;
Koch, Lisa M. ;
Kainz, Bernhard ;
Rueckert, Daniel .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2017, 36 (11) :2204-2215
[5]   Detection and measurement of fetal anatomies from ultrasound images using a constrained probabilistic boosting tree [J].
Carneiro, Gustavo ;
Georaescu, Bogdan ;
Good, Sara ;
Comaniciu, Dorin .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2008, 27 (09) :1342-1355
[6]  
Cerrolaza JJ, 2018, I S BIOMED IMAGING, P564, DOI 10.1109/ISBI.2018.8363639
[7]   Fetal Skull Segmentation in 3D Ultrasound via Structured Geodesic Random Forest [J].
Cerrolaza, Juan J. ;
Oktay, Ozan ;
Gomez, Alberto ;
Matthew, Jacqueline ;
Knight, Caroline ;
Kainz, Bernhard ;
Rueckert, Daniel .
FETAL, INFANT AND OPHTHALMIC MEDICAL IMAGE ANALYSIS, 2017, 10554 :25-32
[8]   Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks [J].
Chen, Hao ;
Ni, Dong ;
Qin, Jing ;
Li, Shengli ;
Yang, Xin ;
Wang, Tianfu ;
Heng, Pheng Ann .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2015, 19 (05) :1627-1636
[9]   REGISTRATION-BASED SEGMENTATION OF THREE-DIMENSIONAL ULTRASOUND IMAGES FOR QUANTITATIVE MEASUREMENT OF FETAL CRANIOFACIAL STRUCTURE [J].
Chen, Hsin-Chen ;
Tsai, Pei-Yin ;
Huang, Hsiao-Han ;
Shih, Hui-Hsuan ;
Wang, Yi-Ying ;
Chang, Chiung-Hsin ;
Sun, Yung-Nien .
ULTRASOUND IN MEDICINE AND BIOLOGY, 2012, 38 (05) :811-823
[10]  
Chollet F., 2015, KERAS