Self-supervised Pairing Image Clustering and Its Application in Cyber Manufacturing

被引:4
作者
Dai, Wenting [1 ]
Jiao, Yutao [1 ]
Erdt, Marius [2 ]
Sourin, Alexei [1 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
[2] Nanyang Technol Univ, Fraunhofer Singapore, Singapore, Singapore
来源
2020 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2020) | 2020年
关键词
Image clustering; Self-supervised pairing; Cyber-manufacturing applications;
D O I
10.1109/CW49994.2020.00012
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Artificial intelligence is being increasingly applied in manufacturing to maximize industrial productivity. Image clustering, as a fundamental research direction in unsupervised learning, has been used in various fields. Since no label information is required in clustering, it can perform a preliminary analysis of the data while saving lots of manpower. In this paper, we propose a novel end-to-end clustering network called Self-supervised Pairing Image Clustering (SPIC) for industrial application, which produces clustering prediction for input images in an advanced pair classification network. For training this network, a self-supervised pairing module is built to form balanced pairs accurately and efficiently without label information. Since the existence of trivial solutions cannot be avoided in most of unsupervised learning methods, two additional information theoretic-constraints regularize the training that ensures the clustering prediction to be unambiguous and close to the real data distribution during training. Experimental results indicate that the proposed SPIC outperforms the state-of-art approaches on manufacturing datasets-NEU and DAGM. It also shows the execellent generalization capability on other genral public datasets, such as MNIST, Omniglot, CIFAR10, and CIFAR100.
引用
收藏
页码:25 / 32
页数:8
相关论文
共 31 条
[1]  
[Anonymous], 2015, ACS SYM SER
[2]  
[Anonymous], 2010, P 27 INT C MACH LEAR, DOI 10.5555/3104322.3104425
[3]  
Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
[4]   Assessing a mixture model for clustering with the integrated completed likelihood [J].
Biernacki, C ;
Celeux, G ;
Govaert, G .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (07) :719-725
[5]  
BRIDLE JS, 1992, ADV NEUR IN, V4, P1096
[6]   Deep Clustering for Unsupervised Learning of Visual Features [J].
Caron, Mathilde ;
Bojanowski, Piotr ;
Joulin, Armand ;
Douze, Matthijs .
COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 :139-156
[7]   Learning a similarity metric discriminatively, with application to face verification [J].
Chopra, S ;
Hadsell, R ;
LeCun, Y .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :539-546
[8]  
Dilokthanakul N., 2016, DEEP UNSUPERVISED CL
[9]   Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization [J].
Dizaji, Kamran Ghasedi ;
Herandi, Amirhossein ;
Deng, Cheng ;
Cai, Weidong ;
Huang, Heng .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5747-5756
[10]  
Fanti C, 2004, ADV NEUR IN, V16, P1603