Group-feature (Sensor) selection with controlled redundancy using neural networks

被引:0
作者
Saha, Aytijhya [1 ]
Pal, Nikhil R. [1 ]
机构
[1] Indian Stat Inst, Kolkata, India
关键词
Dimensionality reduction; Feature selection; Group-feature selection; Sensor selection; Redundancy control; Group lasso; Neural network; GROUP LASSO; REGULARIZATION;
D O I
10.1016/j.neucom.2024.128596
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we present a novel embedded feature selection method based on a Multi-layer Perceptron (MLP) network and generalize it for group-feature or sensor selection problems, which can control the level of redundancy among the selected features or groups and it is computationally more efficient than the existing ones in the literature. Additionally, we have generalized the group lasso penalty for feature selection to encompass a mechanism for selecting valuable groups of features while simultaneously maintaining control over redundancy. We establish the monotonicity and convergence of the proposed algorithm, with a smoothed version of the penalty terms, under suitable assumptions. The effectiveness of the proposed method for both feature selection and group feature selection is validated through experimental results on various benchmark datasets. The performance of the proposed methods is compared with some state-of-the-art methods.
引用
收藏
页数:12
相关论文
共 40 条
  • [1] Unsupervised Feature Selection with Controlled Redundancy (UFeSCoR)
    Banerjee, Monami
    Pal, Nikhil R.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (12) : 3390 - 3403
  • [2] Selecting useful groups of features in a connectionist framework
    Chakraborty, Debrup
    Pal, Nikhil R.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (03): : 381 - 396
  • [3] Feature Selection Using a Neural Framework With Controlled Redundancy
    Chakraborty, Rudrasis
    Pal, Nikhil R.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (01) : 35 - 50
  • [4] SENSOR (GROUP FEATURE) SELECTION WITH CONTROLLED REDUNDANCY IN A CONNECTIONIST FRAMEWORK
    Chakraborty, Rudrasis
    Lin, Chin-Teng
    Pal, Nikhil R.
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2014, 24 (06)
  • [5] Smoothing Nonlinear Conjugate Gradient Method for Image Restoration Using Nonsmooth Nonconvex Minimization
    Chen, Xiaojun
    Zhou, Weijun
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2010, 3 (04): : 765 - 790
  • [6] Feature Selection With Controlled Redundancy in a Fuzzy Rule Based Framework
    Chung, I-Fang
    Chen, Yi-Cheng
    Pal, Nikhil R.
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (02) : 734 - 748
  • [7] UDSFS: Unsupervised deep sparse feature selection
    Cong, Yang
    Wang, Shuai
    Fan, Baojie
    Yang, Yunsheng
    Yu, Haibin
    [J]. NEUROCOMPUTING, 2016, 196 : 150 - 158
  • [8] Feature selection for clustering - A filter solution
    Dash, M
    Choi, K
    Scheuermann, P
    Liu, H
    [J]. 2002 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2002, : 115 - 122
  • [9] Ensemble feature selection using election methods and ranker clustering
    Drotar, Peter
    Gazda, Matej
    Vokorokos, Liberios
    [J]. INFORMATION SCIENCES, 2019, 480 : 365 - 380
  • [10] Bayesian Group Feature Selection for Support Vector Learning Machines
    Du, Changde
    Du, Changying
    Zhe, Shandian
    Luo, Ali
    He, Qing
    Long, Guoping
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2016, PT I, 2016, 9651 : 239 - 252