Multi-level multi-type self-generated knowledge fusion for cardiac ultrasound segmentation

被引:16
作者
Yu, Chengjin [1 ]
Li, Shuang [3 ]
Ghista, Dhanjoo [5 ]
Gao, Zhifan [6 ]
Zhang, Heye [6 ]
Del Ser, Javier [7 ,8 ]
Xu, Lin [2 ,3 ,4 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Hangzhou 310058, Peoples R China
[2] Gen Hosp Southern Theatre Command, Dept Geriatr Cardiol, Guangzhou 510010, Peoples R China
[3] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[4] Southern Med Univ, Clin Med Coll 1, Guangzhou 510010, Peoples R China
[5] Univ 2020 Fdn, Northborough, MA 01532 USA
[6] Sun Yat sen Univ, Sch Biomed Engn, Shenzhen 518107, Peoples R China
[7] TECNALIA, Basque Res & Technol Alliance BRTA, Derio 48160, Spain
[8] Univ Basque Country UPV EHU, Bilbao 48013, Spain
基金
中国国家自然科学基金;
关键词
Multi-level and Multi-type Self-Generated (MM-SG); Deep Neural Networks (DNNs); SLIC (Simple Linear Iterative Clustering) algorithm; Dual Closed-loop Network (DCLNet); Full convolution network (FCN); Anatomically constrained neural network (ACNN);
D O I
10.1016/j.inffus.2022.11.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most existing works on cardiac echocardiography segmentation require a large number of ground-truth labels to appropriately train a neural network; this, however, is time consuming and laborious for physicians. Self -supervision learning is one of the potential solutions to address this challenge by deeply exploiting the raw data. However, existing works mainly exploit single type/level of pretext task. In this work, we propose fusion of the multi-level and multi-type self-generated knowledge. We obtain multi-level information of sub-anatomical structures in ultrasound images via a superpixel method. Subsequently, we fuse various types of information generated through multi-types of pretext tasks. In the end, we transfer the learned knowledge to our downstream task. In the experimental studies, we have demonstrated the prove the effectiveness of this method through the cardiac ultrasound segmentation task. The results show that the performance of our proposed method for echocardiography segmentation matches the performance of fully supervised methods without requiring a high amount of labeled data.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 62 条
  • [1] Achanta R., 2010, Tech. Rep.
  • [2] Alwassel Humam, 2020, Advances in Neural Information Processing Systems
  • [3] Simultaneous Segmentation of Four Cardiac Chambers in Fetal Echocardiography
    An, Shan
    Zhou, Xiaoxue
    Zhu, Haogang
    Zhou, Fangru
    Wu, Yuduo
    Yang, Tingyang
    Liu, Xiangyu
    Zhang, Yingying
    Jiao, Zhicheng
    He, Yihua
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 3122 - 3126
  • [4] [Anonymous], 2010, P 13 INT C ARTIFICIA
  • [5] ACCURACY AND REPRODUCIBILITY OF A NOVEL ARTIFICIAL INTELLIGENCE DEEP LEARNING-BASED ALGORITHM FOR AUTOMATED CALCULATION OF EJECTION FRACTION IN ECHOCARDIOGRAPHY
    Asch, Federico M.
    Abraham, Theodore
    Jankowski, Madeline
    Cleve, Jayne
    Adams, Mike
    Romano, Nathanael
    Polivert, Nicolas
    Hong, Ha
    Lang, Roberto
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF CARDIOLOGY, 2019, 73 (09) : 1447 - 1447
  • [6] Baevski A, 2020, ADV NEUR IN, V33
  • [7] Exploring DeshuffleGANs in Self-Supervised Generative Adversarial Networks
    Baykal, Gulcin
    Ozcelik, Furkan
    Unal, Gozde
    [J]. PATTERN RECOGNITION, 2022, 122
  • [8] STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
    BLAND, JM
    ALTMAN, DG
    [J]. LANCET, 1986, 1 (8476) : 307 - 310
  • [9] Boscaini Davide, 2016, Advances in neural information processing systems, V29
  • [10] Deep Clustering for Unsupervised Learning of Visual Features
    Caron, Mathilde
    Bojanowski, Piotr
    Joulin, Armand
    Douze, Matthijs
    [J]. COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 139 - 156