Illumination-Invariant Flotation Froth Color Measuring via Wasserstein Distance-Based CycleGAN With Structure-Preserving Constraint

被引:62
作者
Liu, Jinping [1 ]
He, Jiezhou [1 ]
Xie, Yongfang [2 ]
Gui, Weihua [2 ]
Tang, Zhaohui [2 ]
Ma, Tianyu [1 ]
He, Junbin [1 ]
Niyoyita, Jean Paul [3 ]
机构
[1] Hunan Normal Univ, Hunan Prov Key Lab Intelligent Comp & Language In, Changsha 410081, Peoples R China
[2] Cent South Univ, Sch Automat, Changsha 410083, Peoples R China
[3] Univ Rwanda, Coll Sci & Technol, Kigali 3900, Rwanda
基金
中国国家自然科学基金;
关键词
Cycle-consistent generative adversarial networks (GANs); flotation froth images; illumination-invariant color characteristics; structure preserving; Wasserstein distance; GENERATIVE ADVERSARIAL NETWORKS; CLASSIFICATION; RECOGNITION; CONSTANCY; MODEL;
D O I
10.1109/TCYB.2020.2977537
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Froth color can be referred to as a direct and instant indicator to the key flotation production index, for example, concentrate grade. However, it is intractable to measure the froth color robustly due to the adverse interference of time-varying and uncontrollable multisource illuminations in the flotation process monitoring. In this article, we proposed an illumination-invariant froth color measuring method by solving a structure-preserved image-to-image color translation task via an introduced Wasserstein distance-based structure-preserving CycleGAN, called WDSPCGAN. WDSPCGAN is comprised of two generative adversarial networks (GANs), which have their own discriminators but share two generators, using an improved U-net-like full convolution network to conduct the spatial structure-preserved color translation. By an adversarial game training of the two GANs, WDSPCGAN can map the color domain of froth images under any illumination to that of the referencing illumination, while maintaining the structure and texture invariance. The proposed method is validated on two public benchmark color constancy datasets and applied to an industrial bauxite flotation process. The experimental results show that WDSPCGAN can achieve illumination-invariant color features of froth images under various unknown lighting conditions while keeping their structures and textures unchanged. In addition, WDSPCGAN can be updated online to ensure its adaptability to any operational conditions. Hence, it has the potential for being popularized to the online monitoring of the flotation concentrate grade.
引用
收藏
页码:839 / 852
页数:14
相关论文
共 47 条
[1]   Online monitoring and control of froth flotation systems with machine vision: A review [J].
Aldrich, C. ;
Marais, C. ;
Shean, B. J. ;
Cilliers, J. J. .
INTERNATIONAL JOURNAL OF MINERAL PROCESSING, 2010, 96 (1-4) :1-13
[2]  
[Anonymous], 2017, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2017.244
[3]  
[Anonymous], 2017, P INT C LEARNING RE
[4]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[5]   A data set for color research [J].
Barnard, K ;
Martin, K ;
Funt, B ;
Coath, A .
COLOR RESEARCH AND APPLICATION, 2002, 27 (03) :147-151
[6]   A 3D froth surface rendering and analysis technique to characterize flotation processes [J].
Bonifazi, G ;
Massacci, P ;
Meloni, A .
INTERNATIONAL JOURNAL OF MINERAL PROCESSING, 2002, 64 (2-3) :153-161
[7]   Estimating the scene illumination chromaticity by using a neural network [J].
Cardei, VC ;
Funt, B ;
Barnard, K .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2002, 19 (12) :2374-2386
[8]   Color Constancy with Spatio-Spectral Statistics [J].
Chakrabarti, Ayan ;
Hirakawa, Keigo ;
Zickler, Todd .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (08) :1509-1519
[9]   An efficient mixed-precision, hybrid CPU-GPU implementation of a nonlinearly implicit one-dimensional particle-in-cell algorithm [J].
Chen, G. ;
Chacon, L. ;
Barnes, D. C. .
JOURNAL OF COMPUTATIONAL PHYSICS, 2012, 231 (16) :5374-5388
[10]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797