Breast mass segmentation in ultrasound with selective kernel U-Net convolutional neural network

被引:182
作者
Byra, Michal [1 ,2 ]
Jarosik, Piotr [3 ]
Szubert, Aleksandra [4 ,5 ]
Galperin, Michael [6 ]
Ojeda-Fournier, Haydee [2 ]
Olson, Linda [2 ]
O'Boyle, Mary [2 ]
Comstock, Christopher [7 ]
Andre, Michael [2 ]
机构
[1] Polish Acad Sci, Inst Fundamental Technol Res, Dept Ultrasound, Warsaw, Poland
[2] Univ Calif San Diego, Dept Radiol, San Diego, CA 92103 USA
[3] Polish Acad Sci, Inst Fundamental Technol Res, Dept Informat & Computat Sci, Warsaw, Poland
[4] Maria Sklodowska Curie Mem Canc Ctr, Warsaw, Poland
[5] Inst Oncol, Warsaw, Poland
[6] Almen Labs, Vista, CA USA
[7] Mem Sloan Kettering Canc Ctr, 1275 York Ave, New York, NY 10021 USA
基金
美国国家卫生研究院;
关键词
Attention mechanism; Breast mass segmentation; Convolutional neural networks; Deep learning; Receptive field; Ultrasound imaging; IMAGE SEGMENTATION; LESIONS; CLASSIFICATION;
D O I
10.1016/j.bspc.2020.102027
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
In this work, we propose a deep learning method for breast mass segmentation in ultrasound (US). Variations in breast mass size and image characteristics make the automatic segmentation difficult. To address this issue, we developed a selective kernel (SK) U-Net convolutional neural network. The aim of the SKs was to adjust network's receptive fields via an attention mechanism, and fuse feature maps extracted with dilated and conventional convolutions. The proposed method was developed and evaluated using US images collected from 882 breast masses. Moreover, we used three datasets of US images collected at different medical centers for testing (893 US images). On our test set of 150 US images, the SK-U-Net achieved mean Dice score of 0.826, and outperformed regular U-Net, Dice score of 0.778. When evaluated on three separate datasets, the proposed method yielded mean Dice scores ranging from 0.646 to 0.780. Additional fine-tuning of our better-performing model with data collected at different centers improved mean Dice scores by similar to 6%. SK-U-Net utilized both dilated and regular convolutions to process US images. We found strong correlation, Spearman's rank coefficient of 0.7, between the utilization of dilated convolutions and breast mass size in the case of network's expansion path. Our study shows the usefulness of deep learning methods for breast mass segmentation. SK-U-Net implementation and pre-trained weights can be found at github.com/mbyr/bus_seg. (C) 2020 The Author(s). Published by Elsevier Ltd.
引用
收藏
页数:10
相关论文
共 32 条
[1]  
Abadi Martin, 2016, Proceedings of OSDI '16: 12th USENIX Symposium on Operating Systems Design and Implementation. OSDI '16, P265
[2]  
Al-Dhabyani W, 2019, INT J ADV COMPUT SC, V10, P618
[3]   Dataset of breast ultrasound images [J].
Al-Dhabyani, Walid ;
Gomaa, Mohammed ;
Khaled, Hussien ;
Fahmy, Aly .
DATA IN BRIEF, 2020, 28
[4]   A deep feature fusion methodology for breast cancer diagnosis demonstrated on three imaging modality datasets [J].
Antropova, Natalia ;
Huynh, Benjamin Q. ;
Giger, Maryellen L. .
MEDICAL PHYSICS, 2017, 44 (10) :5162-5171
[5]   Knee menisci segmentation and relaxometry of 3D ultrashort echo time cones MR imaging using attention U-Net with transfer learning [J].
Byra, Michal ;
Wu, Mei ;
Zhang, Xiaodong ;
Jang, Hyungseok ;
Ma, Ya-Jun ;
Chang, Eric Y. ;
Shah, Sameer ;
Du, Jiang .
MAGNETIC RESONANCE IN MEDICINE, 2020, 83 (03) :1109-1122
[6]   Discriminant analysis of neural style representations for breast lesion classification in ultrasound [J].
Byra, Michal .
BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2018, 38 (03) :684-690
[7]   Classification of breast lesions using segmented quantitative ultrasound maps of homodyned K distribution parameters [J].
Byra, Michal ;
Nowicki, Andrzej ;
Wroblewska-Piotrzkowska, Hanna ;
Dobruch-Sobczak, Katarzyna .
MEDICAL PHYSICS, 2016, 43 (10) :5561-5569
[8]   Breast mass classification in sonography with transfer learning using a deep convolutional neural network and color conversion [J].
Byra, Michel ;
Galperin, Michael ;
Ojeda-Fournier, Haydee ;
Olson, Linda ;
O'Boyle, Mary ;
Comstock, Christopher ;
Andre, Michael .
MEDICAL PHYSICS, 2019, 46 (02) :746-755
[9]   U-Net: deep learning for cell counting, detection, and morphometry [J].
Falk, Thorsten ;
Mai, Dominic ;
Bensch, Robert ;
Cicek, Oezguen ;
Abdulkadir, Ahmed ;
Marrakchi, Yassine ;
Boehm, Anton ;
Deubner, Jan ;
Jaeckel, Zoe ;
Seiwald, Katharina ;
Dovzhenko, Alexander ;
Tietz, Olaf ;
Dal Bosco, Cristina ;
Walsh, Sean ;
Saltukoglu, Deniz ;
Tay, Tuan Leng ;
Prinz, Marco ;
Palme, Klaus ;
Simons, Matias ;
Diester, Ilka ;
Brox, Thomas ;
Ronneberger, Olaf .
NATURE METHODS, 2019, 16 (01) :67-+
[10]  
Han L., 2019, COMPUT METH PROG BIO