Broad Colorization

被引:22
作者
Jin, Yuxi [1 ]
Sheng, Bin [1 ]
Li, Ping [2 ]
Chen, C. L. Philip [3 ,4 ,5 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[2] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
[4] Dalian Maritime Univ, Nav Coll, Dalian, Peoples R China
[5] Univ Macau, Fac Sci & Technol, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Gray-scale; Image color analysis; Learning systems; Neural networks; Training; Computer science; Colorization; global broad learning system (GBLS); global features; local broad learning system (LBLS); local features; IMAGE; COLOR;
D O I
10.1109/TNNLS.2020.3004634
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The scribble- and example-based colorization methods have fastidious requirements for users, and the training process of deep neural networks for colorization is quite time-consuming. We instead proposed an automatic colorization approach with no dependence on user input and no need to endure long training time, which combines local features and global features of the input gray-scale images. Low-, mid-, and high-level features are united as local features representing cues existed in the gray-scale image. The global feature is regarded as data prior to guiding the colorization process. The local broad learning system is trained for getting the chrominance value of each pixel from the local features, which could be expressed as a chrominance map according to the position of pixels. Then, the global broad learning system is trained to refine the chrominance map. There are no requirements for users in our approach, and the training time of our framework is an order of magnitude faster than the traditional methods based on deep neural networks. To increase the user's subjective initiative, our system allows users to increase training data without retraining the system. Substantial experimental results have shown that our approach outperforms state-of-the-art methods.
引用
收藏
页码:2330 / 2343
页数:14
相关论文
共 41 条
[1]  
[Anonymous], 2016, Automatic colorization
[2]  
Charpiat G, 2008, LECT NOTES COMPUT SC, V5304, P126, DOI 10.1007/978-3-540-88690-7_10
[3]   Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture [J].
Chen, C. L. Philip ;
Liu, Zhulin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (01) :10-24
[4]  
Chen CLP, 2017, 2017 32ND YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), P1271, DOI 10.1109/YAC.2017.7967609
[5]   Colorization Using Neural Network Ensemble [J].
Cheng, Zezhou ;
Yang, Qingxiong ;
Sheng, Bin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (11) :5491-5505
[6]   Deep Colorization [J].
Cheng, Zezhou ;
Yang, Qingxiong ;
Sheng, Bin .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :415-423
[7]   Semantic Colorization with Internet Images [J].
Chia, Alex Yong-Sang ;
Zhuo, Shaojie ;
Gupta, Raj Kumar ;
Tai, Yu-Wing ;
Cho, Siu-Yeung ;
Tan, Ping ;
Lin, Stephen .
ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (06)
[8]   COLORIZATION AND MORAL RIGHTS - SHOULD THE UNITED-STATES ADOPT UNIFIED PROTECTION FOR ARTISTS [J].
COOPER, R .
JOURNALISM QUARTERLY, 1991, 68 (03) :465-473
[9]   Learning Large-Scale Automatic Image Colorization [J].
Deshpande, Aditya ;
Rock, Jason ;
Forsyth, David .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :567-575
[10]   In Defense of Locality-Sensitive Hashing [J].
Ding, Kun ;
Huo, Chunlei ;
Fan, Bin ;
Xiang, Shiming ;
Pan, Chunhong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (01) :87-103