Semi-supervised multi-view maximum entropy discrimination with expectation Laplacian regularization

被引:44
作者
Chao, Guoqing [1 ]
Sun, Shiliang [1 ]
机构
[1] East China Normal Univ, Dept Comp Sci & Technol, 3663 North Zhongshan Rd, Shanghai 200062, Peoples R China
基金
中国国家自然科学基金;
关键词
Maximum entropy discrimination; Multi-view learning; Semi-supervised learning; Large-margin; Kernel method; REJECTIVE MULTIPLE TEST;
D O I
10.1016/j.inffus.2018.03.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-supervised multi-view learning has attracted considerable attention and achieved great success in the machine learning field. This paper proposes a semi-supervised multi-view maximum entropy discrimination approach (SMVMED) with expectation Laplacian regularization for data classification. It takes advantage of the geometric information of the marginal distribution embedded in unlabeled data to construct a semi-supervised classifier. Different from existing methods using Laplacian regularization, we propose to use expectation Laplacian regularization for semi-supervised learning in probabilistic models. We give two implementations of SMVMED and provide their kernel variants. One of them can be relaxed and formulated as a quadratic programming problem that is solved easily. Therefore, for this implementation, we provided two versions which are approximate and exact ones. The experiments on one synthetic and multiple real-world data sets show that SMVMED demonstrates superior performance over semi-supervised single-view maximum entropy discrimination, MVMED and other state-of-the-art semi-supervised multi-view learning methods.
引用
收藏
页码:296 / 306
页数:11
相关论文
共 46 条
[1]  
[Anonymous], P INT C MACH LEARN I
[2]  
[Anonymous], 2004, P 21 INT C MACHINE L, DOI DOI 10.1145/1015330.1015426
[3]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[4]  
Bishop C. M., PATTERN RECOGNITION, P703
[5]  
Blum A., 1998, Proceedings of the Eleventh Annual Conference on Computational Learning Theory, P92, DOI 10.1145/279943.279962
[6]   Consensus and complementarity based maximum entropy discrimination for multi-view classification [J].
Chao, Guoqing ;
Sun, Shiliang .
INFORMATION SCIENCES, 2016, 367 :296-310
[7]   Alternative Multiview Maximum Entropy Discrimination [J].
Chao, Guoqing ;
Sun, Shiliang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (07) :1445-1456
[8]   Multi-kernel maximum entropy discrimination for multi-view learning [J].
Chao, Guoqing ;
Sun, Shiliang .
INTELLIGENT DATA ANALYSIS, 2016, 20 (03) :481-493
[9]  
Chao GQ, 2012, LECT NOTES COMPUT SC, V7665, P340, DOI 10.1007/978-3-642-34487-9_42
[10]  
Chatzis Sotirios., 2013, Proceedings of the 30th International Conference on Machine Learning (ICML-13), P729