MDVA-GAN: multi-domain visual attribution generative adversarial networks

被引:0
|
作者
Muhammad Nawaz
Feras Al-Obeidat
Abdallah Tubaishat
Tehseen Zia
Fahad Maqbool
Alvaro Rocha
机构
[1] COMSATS University Islamabad,Medical Imaging and Diagnostic Lab, National Center of Artificial Intelligence
[2] Zayed University,College of Technological Innovation
[3] COMSATS University Islamabad,Department of Computer Science
[4] University of Sargodha,Department of Computer Science
[5] University of Lisbon,undefined
[6] ISEG,undefined
来源
Neural Computing and Applications | 2023年 / 35卷
关键词
Visual attribution; Generative adversarial network; Tuberculosis; Chest X-ray; Change map; Abnormal-to-normal translation;
D O I
暂无
中图分类号
学科分类号
摘要
Some pixels of an input image have thick information and give insights about a particular category during classification decisions. Visualization of these pixels is a well-studied problem in computer vision, called visual attribution (VA), which helps radiologists to recognize abnormalities and identify a particular disease in the medical image. In recent years, several classification-based techniques for domain-specific attribute visualization have been proposed, but these techniques can only highlight a small subset of most discriminative features. Therefore, their generated VA maps are inadequate to visualize all effects in an input image. Due to recent advancements in generative models, generative model-based VA techniques are introduced which generate efficient VA maps and visualize all affected regions. To deal the issue, generative adversarial network-based VA techniques are recently proposed, where the researchers leverage the advances in domain adaption techniques to learn a map for abnormal-to-normal medical image translation. As these approaches rely on a two-domain translation model, it would require training as many models as number of diseases in a medical dataset, which is a tedious and compute-intensive task. In this work, we introduce a unified multi-domain VA model that generates a VA map of more than one disease at a time. The proposed unified model gets images from a particular domain and its domain label as input to generate VA map and visualize all the affected regions by that particular disease. Experiments on the CheXpert dataset, which is a publicly available multi-disease chest radiograph dataset, and the TBX11K dataset show that the proposed model generates identical results.
引用
收藏
页码:8035 / 8050
页数:15
相关论文
共 50 条
  • [1] MDVA-GAN: multi-domain visual attribution generative adversarial networks
    Nawaz, Muhammad
    Al-Obeidat, Feras
    Tubaishat, Abdallah
    Zia, Tehseen
    Maqbool, Fahad
    Rocha, Alvaro
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (11): : 8035 - 8050
  • [2] Texture Deformation Based Generative Adversarial Networks for Multi-domain Face Editing
    Chen, Wenting
    Xie, Xinpeng
    Jia, Xi
    Shen, Linlin
    PRICAI 2019: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2019, 11670 : 257 - 269
  • [3] Pscenegan: Multi-Domain Particular Scenes Generation Based on Conditional Generative Adversarial Networks
    Jia, Li-Li
    Lv, Xiao-Yang
    Cao, Yang-Jie
    Yang, Cong
    Li, Xue-Xiang
    Li, Jie
    IEEE ACCESS, 2019, 7 : 79477 - 79490
  • [4] Dual Generator Generative Adversarial Networks for Multi-domain Image-to-Image Translation
    Tang, Hao
    Xu, Dan
    Wang, Wei
    Yan, Yan
    Sebe, Nicu
    COMPUTER VISION - ACCV 2018, PT I, 2019, 11361 : 3 - 21
  • [5] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation
    Choi, Yunjey
    Choi, Minje
    Kim, Munyoung
    Ha, Jung-Woo
    Kim, Sunghun
    Choo, Jaegul
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8789 - 8797
  • [6] A Deep Learning Model for Multi-Domain MRI Synthesis Using Generative Adversarial Networks
    Han, Le Hoang Ngoc
    Hien, Ngo Le Huy
    Huy, Luu Van
    Hieu, Nguyen Van
    INFORMATICA, 2024, 35 (02) : 283 - 309
  • [7] Crossing-Domain Generative Adversarial Networks for Unsupervised Multi-Domain Image-to-Image Translation
    Yang, Xuewen
    Xie, Dongliang
    Wang, Xin
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 374 - 382
  • [8] MDT: UNSUPERVISED MULTI-DOMAIN IMAGE-TO-IMAGE TRANSLATOR BASED ON GENERATIVE ADVERSARIAL NETWORKS
    Lin, Ye
    Fu, Keren
    Ling, Shenggui
    Cheng, Peng
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 598 - 602
  • [9] A Domain Gap Aware Generative Adversarial Network for Multi-Domain Image Translation
    Xu, Wenju
    Wang, Guanghui
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 72 - 84
  • [10] JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets
    Pu, Yunchen
    Dai, Shuyang
    Gan, Zhe
    Wang, Weiyao
    Wang, Guoyin
    Zhang, Yizhe
    Henao, Ricardo
    Carin, Lawrence
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80