PaletteNet: Image Recolorization with Given Color Palette

被引:31
作者
Cho, Junho [1 ]
Yun, Sangdoo [1 ]
Lee, Kyoungmu [1 ]
Choi, Jin Young [1 ]
机构
[1] Seoul Natl Univ, Dept Elect & Comp Eng, ASRI, Seoul, South Korea
来源
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) | 2017年
关键词
D O I
10.1109/CVPRW.2017.143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image recolorization enhances the visual perception of an image for design and artistic purposes. In this work, we present a deep neural network, referred to as PaletteNet, which recolors an image according to a given target color palette that is useful to express the color concept of an image. PaletteNet takes two inputs: a source image to be recolored and a target palette. PaletteNet is then designed to change the color concept of a source image so that the palette of the output image is close to the target palette. To train PaletteNet, the proposed multi-task loss is composed of Euclidean loss and adversarial loss. The experimental results show that the proposed method outperforms the existing recolorization methods. Human experts with a commercial software take on average 18 minutes to recolor an image, while PaletteNet automatically recolors plausible results in less than a second.
引用
收藏
页码:1058 / 1066
页数:9
相关论文
共 12 条
[1]  
[Anonymous], 2016, ARXIV160303417
[2]  
[Anonymous], 2016, ARXIV E PRINTS
[3]   Interactive Image Colorization Using Laplacian Coordinates [J].
Casaca, Wallace ;
Colnago, Marilaine ;
Nonato, Luis Gustavo .
COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2015, PT II, 2015, 9257 :675-686
[4]   Palette-based Photo Recoloring [J].
Chang, Huiwen ;
Fried, Ohad ;
Liu, Yiming ;
DiVerdi, Stephen ;
Finkelstein, Adam .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (04)
[5]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[6]  
Greenfield GR, 2003, WSCG'2003, VOL 11, NO 1, CONFERENCE PROCEEDINGS, P189
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]  
Ioffe S., 2015, ARXIV150203167, P448, DOI DOI 10.48550/ARXIV.1502.03167
[9]  
King DB, 2015, ACS SYM SER, V1214, P1
[10]   An Efficient Naturalness-Preserving Image-Recoloring Method for Dichromats [J].
Kuhn, Giovane R. ;
Oliveira, Manuel M. ;
Fernandes, Leandro A. F. .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2008, 14 (06) :1747-1754