Multi-view representation learning in multi-task scene

被引:4
作者
Lu, Run-kun [1 ]
Liu, Jian-wei [1 ]
Lian, Si-ming [1 ]
Zuo, Xin [1 ]
机构
[1] China Univ Petr, Coll Informat Sci & Engn, Dept Automat, Beijing Campus CUP,260 Mailbox, Beijing 102249, Peoples R China
基金
国家重点研发计划;
关键词
Multi-view; Multi-task; Latent representation; Special feature; Common feature;
D O I
10.1007/s00521-019-04577-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Over recent decades have witnessed considerable progress in whether multi-task learning or multi-view learning, but the situation that considers both learning scenes simultaneously has received not too much attention. How to utilize multiple views' latent representation of each single task to improve each learning task's performance is a challenge problem. Based on this, we proposed a novel semi-supervised algorithm, termed as multi-task multi-view learning based on common and special features (MTMVCSF). In general, multi-views are the different aspects of an object and every view includes the underlying common or special information of this object. As a consequence, we will mine multiple views' jointly latent factor of each learning task, jointly latent factor is consisted of each view's special feature and the common feature of all views. By this way, the original multi-task multi-view data have degenerated into multi-task data, and exploring the correlations among multiple tasks enables to make an improvement on the performance of learning algorithm. Another obvious advantage of this approach is that we get latent representation of the set of unlabeled instances by the constraint of regression task with labeled instances. In classification and semi-supervised clustering tasks, using implicit representation as input peforms much better than using raw data. Furthermore, an anti-noise multi-task multi-view algorithm called AN-MTMVCSF is proposed, which has a strong adaptability to noise labels. The effectiveness of these algorithms is proved by a series of well-designed experiments on both real-world and synthetic data.
引用
收藏
页码:10403 / 10422
页数:20
相关论文
共 53 条
  • [1] Argyriou Andreas, 2007, Advances in Neural Information Processing Systems, P41
  • [2] Learning Deep Architectures for AI
    Bengio, Yoshua
    [J]. FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01): : 1 - 127
  • [3] Blum A., 1998, Proceedings of the Eleventh Annual Conference on Computational Learning Theory, P92, DOI 10.1145/279943.279962
  • [4] Alternative Multiview Maximum Entropy Discrimination
    Chao, Guoqing
    Sun, Shiliang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (07) : 1445 - 1456
  • [5] Chaudhuri Kamalika, 2009, P 26 ANN INT C MACH, P129
  • [6] Tensor-Based Low-Dimensional Representation Learning for Multi-View Clustering
    Cheng, Miaomiao
    Jing, Liping
    Ng, Michael K.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) : 2399 - 2414
  • [7] Chowdhury G.G., 2010, INTRO MODERN INFORM
  • [8] MV-RNN: A Multi-View Recurrent Neural Network for Sequential Recommendation
    Cui, Qiang
    Wu, Shu
    Liu, Qiang
    Zhong, Wen
    Wang, Liang
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (02) : 317 - 331
  • [9] Detecting hot topics from Twitter: A multiview approach
    Fang, Yixiang
    Zhang, Haijun
    Ye, Yunming
    Li, Xutao
    [J]. JOURNAL OF INFORMATION SCIENCE, 2014, 40 (05) : 578 - 593
  • [10] Foutch Ellery., 2005, Moving Pictures: American Art and Early Film, 1880-1910, P134