Group Lasso based redundancy-controlled feature selection for fuzzy neural network

被引:1
作者
Yang, Jun [1 ]
Xu, Yongyong [1 ]
Wang, Bin [1 ]
Li, Bo [1 ]
Huang, Ming [1 ]
Gao, Tao [1 ]
机构
[1] 15th Res Inst China Elect Technol Grp Corp, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
A; MUTUAL INFORMATION; IDENTIFICATION; RELEVANCE;
D O I
10.1007/s11801-023-2053-x
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
If there are a lot of inputs, the readability of the "If-then" fuzzy rule is reduced, and the complexity of the fuzzy neural network structure will be increased. Hence, to optimize the structure of the fuzzy rule based neural network, a group Lasso based redundancy-controlled feature selection (input pruning) method is proposed. For realizing feature selection, the linear/nonlinear redundancy between features is considered, and the Pearson's correlation coefficient is employed to construct the additive redundancy-controlled regularizer in the error function. In addition, considering the past gradient information, a novel parameter optimization method is presented. Finally, we demonstrate the effectiveness of our method on two benchmark classification datasets.
引用
收藏
页码:284 / 289
页数:6
相关论文
共 23 条
  • [1] Margin-Maximizing Feature Elimination Methods for Linear and Nonlinear Kernel-Based Discriminant Functions
    Aksu, Yaman
    Miller, David J.
    Kesidis, George
    Yang, Qing X.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (05): : 701 - 717
  • [2] USING MUTUAL INFORMATION FOR SELECTING FEATURES IN SUPERVISED NEURAL-NET LEARNING
    BATTITI, R
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04): : 537 - 550
  • [3] Feature Selection Based on a Sparse Neural-Network Layer With Normalizing Constraints
    Bugata, Peter
    Drotar, Peter
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (01) : 161 - 172
  • [4] An Integrated Mechanism for Feature Selection and Fuzzy Rule Extraction for Classification
    Chen, Yi-Cheng
    Pal, Nikhil R.
    Chung, I-Fang
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2012, 20 (04) : 683 - 698
  • [5] Feature Selection With Controlled Redundancy in a Fuzzy Rule Based Framework
    Chung, I-Fang
    Chen, Yi-Cheng
    Pal, Nikhil R.
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (02) : 734 - 748
  • [6] Normalized Mutual Information Feature Selection
    Estevez, Pablo. A.
    Tesmer, Michel
    Perez, Claudio A.
    Zurada, Jacek A.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (02): : 189 - 201
  • [7] Gao T., 2021, FEATURE SELECTION FU, P1
  • [8] Gao T., 2021, REDUNDANCY CONTROLLE, P172
  • [9] Adaptive Type-2 Fuzzy Neural Network Inherited Terminal Sliding Mode Control for Power Quality Improvement
    Hou, Shixi
    Chu, Yundi
    Fei, Juntao
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (11) : 7564 - 7574
  • [10] An efficient fuzzy classifier with feature selection based on fuzzy entropy
    Lee, HM
    Chen, CM
    Chen, JM
    Jou, YL
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2001, 31 (03): : 426 - 432