Feature co-shrinking for co-clustering

被引:7
作者
Tan, Qi [1 ]
Yang, Pei [2 ,3 ]
He, Jingrui [3 ]
机构
[1] South China Normal Univ, Dept Comp Sci & Engn, Guangzhou 510630, Guangdong, Peoples R China
[2] South China Univ Technol, Dept Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
[3] Arizona State Univ, Dept Comp Sci & Engn, Tempe, AZ 85281 USA
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Co-clustering; Non-negative matrix tri-factorization; Co-sparsity; Co-feature-selection; SELECTION; CLASSIFICATION;
D O I
10.1016/j.patcog.2017.12.005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many real-world applications require multi-way feature selection rather than single-way feature selection. Multi-way feature selection is more challenging compared to single-way feature selection due to the presence of inter-correlation among the multi-way features. To address this challenge, we propose a novel non-negative matrix tri-factorization model based on co-sparsity regularization to facilitate feature co-shrinking for co-clustering. The basic idea is to learn the inter-correlation among the multi-way features while shrinking the irrelevant ones by encouraging the co-sparsity of the model parameters. The objective is to simultaneously minimize the loss function for the matrix tri-factorization, and the co-sparsity regularization imposed on the model. Furthermore, we develop an efficient and convergence-guaranteed algorithm to solve the non-smooth optimization problem, which works in an iteratively update fashion. The experimental results on various data sets demonstrate the effectiveness of the proposed approach. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:12 / 19
页数:8
相关论文
共 38 条
  • [1] [Anonymous], 2013, DATA CLUSTERING ALGO
  • [2] [Anonymous], DEEP NMF SPEECH SEPA
  • [3] [Anonymous], DATA CLASSIFICATION
  • [4] [Anonymous], 2011, P 20 ACM INT C INF K, DOI DOI 10.1145/2063576.2063676
  • [5] On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual Information
    Balagani, Kiran S.
    Phoha, Vir V.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (07) : 1342 - 1343
  • [6] Banerjee A, 2007, J MACH LEARN RES, V8, P1919
  • [7] Metagenes and molecular pattern discovery using matrix factorization
    Brunet, JP
    Tamayo, P
    Golub, TR
    Mesirov, JP
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2004, 101 (12) : 4164 - 4169
  • [8] Graph Regularized Nonnegative Matrix Factorization for Data Representation
    Cai, Deng
    He, Xiaofei
    Han, Jiawei
    Huang, Thomas S.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) : 1548 - 1560
  • [9] Co-ClusterD: A Distributed Framework for Data Co-Clustering with Sequential Updates
    Cheng, Xiang
    Su, Sen
    Gao, Lixin
    Yin, Jiangtao
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (12) : 3231 - 3244
  • [10] Dhillon I. S., 2001, KDD-2001. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, P269, DOI 10.1145/502512.502550