Toward Realistic Image Compositing with Adversarial Learning

被引:43
作者
Chen, Bor-Chun [1 ]
Kae, Andrew [2 ]
机构
[1] Univ Maryland, College Pk, MD 20742 USA
[2] Verizon Media Grp, Boston, MA USA
来源
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) | 2019年
关键词
D O I
10.1109/CVPR.2019.00861
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compositing a realistic image is a challenging task and usually requires considerable human supervision using professional image editing software. In this work we propose a generative adversarial network (GAN) architecture for automatic image compositing. The proposed model consists of four sub-networks: a transformation network that improves the geometric and color consistency of the composite image, a refinement network that polishes the boundary of the composite image, and a pair of discriminator network and a segmentation network for adversarial learning. Experimental results on both synthesized images and real images show that our model, Geometrically and Color Consistent GANs (GCC-GANs), can automatically generate realistic composite images compared to several state-of-the-art methods, and does not require any manual effort.
引用
收藏
页码:8407 / 8416
页数:10
相关论文
共 35 条
  • [1] Interactive digital photomontage
    Agarwala, A
    Dontcheva, M
    Agrawala, M
    Drucker, S
    Colburn, A
    Curless, B
    Salesin, D
    Cohen, M
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03): : 294 - 302
  • [2] [Anonymous], 2008, ACM SIGGRAPH 2008 classes
  • [3] [Anonymous], 2017, P IEEE C COMP VIS PA, DOI DOI 10.1109/CVPR.2017.19
  • [4] [Anonymous], 2017, P IEEE C COMP VIS PA
  • [5] [Anonymous], 2014, ARXIV PREPRINT ARXIV
  • [6] A MULTIRESOLUTION SPLINE WITH APPLICATION TO IMAGE MOSAICS
    BURT, PJ
    ADELSON, EH
    [J]. ACM TRANSACTIONS ON GRAPHICS, 1983, 2 (04): : 217 - 236
  • [7] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [8] A Perceptual Measure for Deep Single Image Camera Calibration
    Hold-Geoffroy, Yannick
    Sunkavalli, Kalyan
    Eisenmann, Jonathan
    Fisher, Matt
    Gambaretto, Emiliano
    Hadap, Sunil
    Lalonde, Jean-Francois
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2354 - 2363
  • [9] Deep Outdoor Illumination Estimation
    Hold-Geoffroy, Yannick
    Sunkavalli, Kalyan
    Hadap, Sunil
    Gambaretto, Emiliano
    Lalonde, Jean-Francois
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2373 - 2382
  • [10] Globally and Locally Consistent Image Completion
    Iizuka, Satoshi
    Simo-Serra, Edgar
    Ishikawa, Hiroshi
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):