Automatic Diagnosis Method of Ultrasound Image Based onHeterogeneous Multi-Branch Network

被引:0
|
作者
Li X.-X. [1 ]
Shi E. [2 ]
机构
[1] School of Computer and Software, Jincheng College of Sichuan University, Chengdu
[2] School of Information Science and Technology, Southwest Jiaotong University, Chengdu
关键词
Breast ultrasound; Contrast-enhanced ultrasound; Heterogeneous data; Pathology; Ultrasound classification;
D O I
10.12178/1001-0548.2020246
中图分类号
学科分类号
摘要
Objective Ultrasound (US) is one of a primary imageological examination and preoperative assessment for breast nodules. However, in the field of ultrasound diagnosis, it relies heavily on the experience of physicians due to the overlapping image expression of benign and malignant breast nodules. Computer-aided medical diagnosis has gradually become a hot spot of current research. In this paper, a heterogeneous multi-branch network (HMBN) is presented for benign and malignant classification of the breast ultrasound images. In HMBN, the image information includes ultrasound images and contrast-enhanced ultrasound (CEUS) images while non-image information includes patients' age and other six pathological features. On the other hand, a fusion loss function suitable for this heterogeneous multi-branch network is also proposed. This loss function uses the minimum hyperspherical energy (MHE) based on additive angular margin loss to improve the classification accuracy. Experimental results show that on the breast ultrasound data set of 1303 cases collected, the classification accuracy of the proposed heterogeneous multi-branch network is 92.41%, which is 7.11% higher than the average diagnostic accuracy of doctors with five years of experience, and ranks among the best in diagnostic accuracy in comparison with other latest research results. It is proved that the accuracy and robustness of breast diagnosis are greatly improved by incorporating medical knowledge into the optimization process and adding contrast-enhanced ultrasound images and non-image information to the network. Copyright ©2021 Journal of University of Electronic Science and Technology of China. All rights reserved.
引用
收藏
页码:214 / 224
页数:10
相关论文
共 22 条
  • [1] PISANI P, PARKIN D M, FERLAY J., Estimates of the worldwide mortality from eighteen major cancers in 1985. Implications for prevention and projections of future burden, Int J Cancer, 55, 6, pp. 891-903, (1993)
  • [2] GIGER M L, CHAN H P, BOONE J., Anniversary paper: History and status of CAD and quantitative image analysis: The role of medical physics and AAPM, Medical Physics, 35, 12, pp. 5799-5820, (2008)
  • [3] HANJALIC A, ZHANG H J., An integrated scheme for automated video abstraction based on unsupervised cluster validity analysis, IEEE Transactions on Circuits and Systems for Video Technology, 9, 8, pp. 1280-1289, (1999)
  • [4] BASELICE F, FERRAIOLI G, PASCAZIO V, Et al., Enhanced wiener filter for ultrasound image denoising, European Medical and Biological Engineering Conference Nordic-Baltic Conference on Biomedical Engineering and Medical Physics, pp. 65-68, (2017)
  • [5] SINGH P, MUKUNDAN R, RYKE R D., Feature enhancement in medical ultrasound videos using multifractal and contrast adaptive histogram equalization techniques, The 2nd International Conference on Multimedia Information Processing and Retrieval (MIPR), pp. 240-245, (2019)
  • [6] DENG Jian-kang, GUO Jia, XUE Nian-nan, Et al., ArcFace: Additive angular margin loss for deep face recognition, Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4690-4699, (2019)
  • [7] LIU W, LIN R, LIU Z, Et al., Learning towards minimum hyperspherical energy, Proceedings of the 32nd International Conference on Neural Information Processing SystemsDecember (NeurIPS), pp. 6225-6236, (2018)
  • [8] JAMIESON A, DRUKKER K, GIGER M., Breast image feature learning with adaptive deconvolutional networks, Proceedings of the SPIE Medical Imaging, pp. 64-76, (2012)
  • [9] ANTROPOVA N, HUYNH B Q, GIGER M L., A deep feature fusion methodology for breast cancer diagnosis demonstrated on three imaging modality datasets, Medical Physics, 44, 10, pp. 5162-5171, (2017)
  • [10] KONG X, TAN T, BAO L, Et al., Classification of breast mass in 3D ultrasound images with annotations based on convolutional neural networks, Chinese Journal of Biomedical Engineering, 37, 4, pp. 414-422, (2018)