Effective extraction of ventricles and myocardium objects from cardiac magnetic resonance images with a multi-task learning U-Net

被引:8
|
作者
Ren, Jinchang [1 ,2 ]
Sun, He [3 ]
Zhao, Huimin [1 ]
Gao, Hao [4 ]
Maclellan, Calum [5 ]
Zhao, Sophia [5 ]
Luo, Xiaoyu [4 ]
机构
[1] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou 510655, Peoples R China
[2] Robert Gordon Univ, Natl Subsea Ctr, Aberdeen, Scotland
[3] Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
[4] Univ Glasgow, Sch Math & Stat, Glasgow, Lanark, Scotland
[5] Univ Strathclyde, Ctr Signal & Image Proc, Glasgow, Lanark, Scotland
基金
中国国家自然科学基金; 英国工程与自然科学研究理事会;
关键词
U-Net; Multi-task learning; Magnetic resonance images (MRI); Ventricles and myocardium extraction; Fusion-based decoder; CLASSIFICATION; SEGMENTATION;
D O I
10.1016/j.patrec.2021.10.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate extraction of semantic objects such as ventricles and myocardium from magnetic resonance (MR) images is one essential but very challenging task for the diagnosis of the cardiac diseases. To tackle this problem, in this paper, an automatic end-to-end supervised deep learning framework is proposed, using a multi-task learning based U-Net (MTL-UNet). Specifically, an edge extraction module and a fusion-based module are introduced for effectively capturing the contextual information such as continuous edges and consistent spatial patterns in terms of intensity and texture features. With a weighted triple loss including the dice loss, the cross-entropy loss and the edge loss, the accuracy of object segmentation and extraction has been effectively improved. Extensive experiments on the publicly available ACDC 2017 dataset have validated the efficacy and efficiency of the proposed MTL-UNet model. (C) 2021 Published by Elsevier B.V.
引用
收藏
页码:165 / 170
页数:6
相关论文
共 50 条
  • [21] Multi-Task Learning U-Net for Single-Channel Speech Enhancement and Mask-Based Voice Activity Detection
    Lee, Geon Woo
    Kim, Hong Kook
    APPLIED SCIENCES-BASEL, 2020, 10 (09):
  • [22] A multi-task learning method for extraction of newly constructed areas based on bi-temporal hyperspectral images
    Tu, Lilin
    Huang, Xin
    Li, Jiayi
    Yang, Jie
    Gong, Jianya
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 208 : 308 - 323
  • [23] MT-UNET: A NOVEL U-NET BASED MULTI-TASK ARCHITECTURE FOR VISUAL SCENE UNDERSTANDING
    Jha, Ankit
    Kumar, Awanish
    Pande, Shivam
    Banerjee, Biplab
    Chaudhuri, Subhasis
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2191 - 2195
  • [24] A Multi-Task Learning Framework for Automated Segmentation and Classification of Breast Tumors From Ultrasound Images
    Chowdary, Jignesh
    Yogarajah, Pratheepan
    Chaurasia, Priyanka
    Guruviah, Velmathi
    ULTRASONIC IMAGING, 2022, 44 (01) : 3 - 12
  • [25] Multi-task Swin Transformer for Motion Artifacts Classification and Cardiac Magnetic Resonance Image Segmentation
    Grzeszczyk, Michal K.
    Plotka, Szymon
    Sitek, Arkadiusz
    STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART: REGULAR AND CMRXMOTION CHALLENGE PAPERS, STACOM 2022, 2022, 13593 : 409 - 417
  • [26] Glioma segmentation with DWI weighted images, conventional anatomical images, and post-contrast enhancement magnetic resonance imaging images by U-Net
    Amir Khorasani
    Rahele Kafieh
    Masih Saboori
    Mohamad Bagher Tavakoli
    Physical and Engineering Sciences in Medicine, 2022, 45 : 925 - 934
  • [27] Extraction of Terraces in Hilly Areas from Remote Sensing Images Using DEM and Improved U-Net
    Peng, Fengcan
    Peng, Qiuzhi
    Chen, Di
    Lu, Jiating
    Song, Yufei
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2024, 90 (03) : 181 - 188
  • [28] Glioma segmentation with DWI weighted images, conventional anatomical images, and post-contrast enhancement magnetic resonance imaging images by U-Net
    Khorasani, Amir
    Kafieh, Rahele
    Saboori, Masih
    Tavakoli, Mohamad Bagher
    PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2022, 45 (3) : 925 - 934
  • [29] mfeeU-Net: A multi-scale feature extraction and enhancement U-Net for automatic liver segmentation from CT Images
    Liu, Jun
    Yan, Zhenhua
    Zhou, Chaochao
    Shao, Liren
    Han, Yuanyuan
    Song, Yusheng
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (05) : 7784 - 7801
  • [30] On the Exploration of Automatic Building Extraction from RGB Satellite Images Using Deep Learning Architectures Based on U-Net
    Temenos, Anastasios
    Temenos, Nikos
    Doulamis, Anastasios
    Doulamis, Nikolaos
    TECHNOLOGIES, 2022, 10 (01)