QR-GAN: Generative Adversarial Networks meet Quantile Regression

被引:0
作者
Lee, Sunyeop [1 ]
Nguyen, Than Anh [2 ]
Min, Dugki [2 ]
机构
[1] Konkuk Univ, Coll Engn, Dept Comp Sci & Engn, Seoul 05029, South Korea
[2] Konkuk Univ, Konkuk Aerosp Design Airworthiness Inst KADA, Grad Sch, Dept Artificial Intelligence, Seoul 05029, South Korea
来源
2023 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE, ICACI | 2023年
基金
新加坡国家研究基金会;
关键词
Generative Models; Quantile Regression; Generative Adversarial Networks; Training Stability; Robustness;
D O I
10.1109/ICACI58115.2023.10146143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a novel Quantile Regression Generative Adversarial Networks (QR-GAN), which uses quartile regression to improve GAN performance by mitigating issues of GAN such as non-convergence, mode collapse, and gradient problems. Instead of directly minimizing the 1 -Wasserstein distance between real and generated data distributions, as in WGANs, the proposed method leverages the quantile loss to encourage the generator to produce a diverse range of outputs. Additionally, we conduct an in-depth analysis of the output space of the discriminator and the gradients of fake samples to identify the root causes of mode collapse. Our study reveals that constraining the discriminator to specific values can lead to mode collapse. The proposed QR-GAN method exhibits a high level of robustness against mode collapse and significantly improves the generation performance, as measured by the Frechet Inception Distance (FID) metric, compared to other GAN variants. These findings suggest that the proposed QR-GAN method has the potential to advance the state-of-the-art in GAN research and improve their applicability in a variety of domains.
引用
收藏
页数:8
相关论文
共 19 条
  • [1] Arjovsky M, 2017, PR MACH LEARN RES, V70
  • [2] BELLEMARE MG, 2017, P MACHINE LEARNING R, V70
  • [3] Dabney W., 2017, ARXIV171010044CSAI
  • [4] A distributional code for value in dopamine-based reinforcement learning
    Dabney, Will
    Kurth-Nelson, Zeb
    Uchida, Naoshige
    Starkweather, Clara Kwon
    Hassabis, Demis
    Munos, Remi
    Botvinick, Matthew
    [J]. NATURE, 2020, 577 (7792) : 671 - +
  • [5] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [6] Gulrajani I., 2017, PROC 31 INT C NEURAL, P5769
  • [7] Heusel Martin, 2018, ARXIV170608500CSLG
  • [8] Kingma D. P., 2014, arXiv
  • [9] Koenker R., 2005, QUANTILE REGRESSION
  • [10] Makhzani A., 2016, ARXIV151105644CSLG