Effective extraction of ventricles and myocardium objects from cardiac magnetic resonance images with a multi-task learning U-Net

被引:8
|
作者
Ren, Jinchang [1 ,2 ]
Sun, He [3 ]
Zhao, Huimin [1 ]
Gao, Hao [4 ]
Maclellan, Calum [5 ]
Zhao, Sophia [5 ]
Luo, Xiaoyu [4 ]
机构
[1] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou 510655, Peoples R China
[2] Robert Gordon Univ, Natl Subsea Ctr, Aberdeen, Scotland
[3] Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
[4] Univ Glasgow, Sch Math & Stat, Glasgow, Lanark, Scotland
[5] Univ Strathclyde, Ctr Signal & Image Proc, Glasgow, Lanark, Scotland
基金
中国国家自然科学基金; 英国工程与自然科学研究理事会;
关键词
U-Net; Multi-task learning; Magnetic resonance images (MRI); Ventricles and myocardium extraction; Fusion-based decoder; CLASSIFICATION; SEGMENTATION;
D O I
10.1016/j.patrec.2021.10.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate extraction of semantic objects such as ventricles and myocardium from magnetic resonance (MR) images is one essential but very challenging task for the diagnosis of the cardiac diseases. To tackle this problem, in this paper, an automatic end-to-end supervised deep learning framework is proposed, using a multi-task learning based U-Net (MTL-UNet). Specifically, an edge extraction module and a fusion-based module are introduced for effectively capturing the contextual information such as continuous edges and consistent spatial patterns in terms of intensity and texture features. With a weighted triple loss including the dice loss, the cross-entropy loss and the edge loss, the accuracy of object segmentation and extraction has been effectively improved. Extensive experiments on the publicly available ACDC 2017 dataset have validated the efficacy and efficiency of the proposed MTL-UNet model. (C) 2021 Published by Elsevier B.V.
引用
收藏
页码:165 / 170
页数:6
相关论文
共 50 条
  • [1] Segmentation of Remote Sensing Images Based on U-Net Multi-Task Learning
    Ni Ruiwen
    Mu Ye
    Li Ji
    Zhang Tong
    Luo Tianye
    Feng Ruilong
    Gong He
    Hu Tianli
    Sun Yu
    Guo Ying
    Li Shijun
    Tyasi, Thobela Louis
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (02): : 3263 - 3274
  • [2] LESION ATTRIBUTES SEGMENTATION FOR MELANOMA DETECTION WITH MULTI-TASK U-NET
    Chen, Eric Z.
    Dong, Xu
    Li, Xiaoxiao
    Jiang, Hongda
    Rong, Ruichen
    Wu, Junyan
    2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019), 2019, : 485 - 488
  • [3] HF-UNet: Learning Hierarchically Inter-Task Relevance in Multi-Task U-Net for Accurate Prostate Segmentation in CT Images
    He, Kelei
    Lian, Chunfeng
    Zhang, Bing
    Zhang, Xin
    Cao, Xiaohuan
    Nie, Dong
    Gao, Yang
    Zhang, Junfeng
    Shen, Dinggang
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (08) : 2118 - 2128
  • [4] SEMANTIC SEGMENTATION AND CHANGE DETECTION BY MULTI-TASK U-NET
    Tsutsui, Shungo
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 619 - 623
  • [5] Encoder Modified U-Net and Feature Pyramid Network for Multi-class Segmentation of Cardiac Magnetic Resonance Images
    Sharan, Taresh Sarvesh
    Tripathi, Sumit
    Sharma, Shiru
    Sharma, Neeraj
    IETE TECHNICAL REVIEW, 2022, 39 (05) : 1092 - 1104
  • [6] A Multi-task learning U-Net model for end-to-end HEp-2 cell image analysis
    Percannella, Gennaro
    Petruzzello, Umberto
    Tortorella, Francesco
    Vento, Mario
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2025, 159
  • [7] A novel U-Net approach to segment the cardiac chamber in magnetic resonance images with ghost artifacts
    Zhao, Ming
    Wei, Yang
    Lu, Yu
    Wong, Kelvin K. L.
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 196 (196)
  • [8] Automatic calcaneus fracture identification and segmentation using a multi-task U-Net
    Mu, Yuxuan
    Xue, Dong
    Guo, Jia
    Xu, Hailin
    Wang, Wei
    Li, Huiqi
    2020 5TH INTERNATIONAL CONFERENCE ON COMMUNICATION, IMAGE AND SIGNAL PROCESSING (CCISP 2020), 2020, : 140 - 144
  • [9] IUML: INCEPTION U-NET BASED MULTI-TASK LEARNING FOR DENSITY LEVEL CLASSIFICATION AND CROWD DENSITY ESTIMATION
    Huynh, Van-Su
    Vu-Hoang Tran
    Huang, Ching-Chun
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 3019 - 3024
  • [10] Improved Extraction of Objects from Urine Microscopy Images with Unsupervised Thresholding and Supervised U-net Techniques
    Aziz, Abdul
    Pande, Harshit
    Cheluvaraju, Bharath
    Dastidar, Tathagato Rai
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 2311 - 2319