Multi-task learning for quality assessment of fetal head ultrasound images

被引:93
作者
Lin, Zehui [1 ]
Li, Shengli [2 ]
Ni, Dong [1 ]
Liao, Yimei [2 ]
Wen, Huaxuan [2 ]
Du, Jie [1 ]
Chen, Siping [1 ]
Wang, Tianfu [1 ]
Lei, Baiying [1 ]
机构
[1] Shenzhen Univ, Natl Reg Key Technol Engn Lab Med Ultrasound, Guangdong Key Lab Biomed Measurements & Ultrasoun, Sch Biomed Engn,Hlth Sci Ctr, Shenzhen 518060, Peoples R China
[2] Nanfang Med Univ, Affiliated Shenzhen Maternal & Child Healthcare H, Dept Ultrasound, 3012 Fuqiang Rd, Shenzhen 518060, Peoples R China
基金
中国国家自然科学基金;
关键词
Fetal head standard plane; Ultrasound image quality assessment; Anatomical structure detection; Multi-task learning; STANDARD PLANE LOCALIZATION; NETWORKS; BRAIN;
D O I
10.1016/j.media.2019.101548
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It is essential to measure anatomical parameters in prenatal ultrasound images for the growth and development of the fetus, which is highly relied on obtaining a standard plane. However, the acquisition of a standard plane is, in turn, highly subjective and depends on the clinical experience of sonographers. In order to deal with this challenge, we propose a new multi-task learning framework using a faster regional convolutional neural network (MF R-CNN) architecture for standard plane detection and quality assessment. MF R-CNN can identify the critical anatomical structure of the fetal head and analyze whether the magnification of the ultrasound image is appropriate, and then performs quality assessment of ultrasound images based on clinical protocols. Specifically, the first five convolution blocks of the MF R-CNN learn the features shared within the input data, which can be associated with the detection and classification tasks, and then extend to the task-specific output streams. In training, in order to speed up the different convergence of different tasks, we devise a section train method based on transfer learning. In addition, our proposed method also uses prior clinical and statistical knowledge to reduce the false detection rate. By identifying the key anatomical structure and magnification of the ultrasound image, we score the ultrasonic plane of fetal head to judge whether it is a standard image or not. Experimental results on our own-collected dataset show that our method can accurately make a quality assessment of an ultrasound plane within half a second. Our method achieves promising performance compared with state-of-the-art methods, which can improve the examination effectiveness and alleviate the measurement error caused by improper ultrasound scanning. (C) 2019 Published by Elsevier B.V.
引用
收藏
页数:14
相关论文
共 52 条
[1]  
[Anonymous], IEEE C COMP VIS PATT
[2]  
[Anonymous], ARXIV180409102
[3]  
[Anonymous], ULTRASOUND OBSTET GY
[4]  
[Anonymous], IEEE T GEOSCI NEURAL
[5]  
[Anonymous], 2008, ULTRASOUND FETAL SYN
[6]  
[Anonymous], INT J COMPUT ASSIST
[7]  
[Anonymous], ARXIV181108164
[8]   SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound [J].
Baumgartner, Christian F. ;
Kamnitsas, Konstantinos ;
Matthew, Jacqueline ;
Fletcher, Tara P. ;
Smith, Sandra ;
Koch, Lisa M. ;
Kainz, Bernhard ;
Rueckert, Daniel .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2017, 36 (11) :2204-2215
[9]   Soft-NMS - Improving Object Detection With One Line of Code [J].
Bodla, Navaneeth ;
Singh, Bharat ;
Chellappa, Rama ;
Davis, Larry S. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5562-5570
[10]   DOES ROUTINE ULTRASOUND SCANNING IMPROVE OUTCOME IN PREGNANCY - METAANALYSIS OF VARIOUS OUTCOME MEASURES [J].
BUCHER, HC ;
SCHMIDT, JG .
BMJ-BRITISH MEDICAL JOURNAL, 1993, 307 (6895) :13-17