Interpretability Diversity for Decision-Tree-Initialized Dendritic Neuron Model Ensemble

被引:7
|
作者
Luo, Xudong [1 ,2 ]
Ye, Long [1 ]
Liu, Xiaolan [3 ]
Wen, Xiaohao [4 ,5 ]
Zhou, Mengchu [6 ]
Zhang, Qin [7 ]
机构
[1] Commun Univ China, State Key Lab Media Convergence & Commun, Beijing 100024, Peoples R China
[2] Guangxi Normal Univ, Sch Comp Sci & Engn, Guilin 541004, Peoples R China
[3] Hengshui Univ, Coll Elect & Informat Engn, Hengshui 053000, Peoples R China
[4] Guangxi Normal Univ, Teachers Coll Vocat & Tech Educ, Guilin 541004, Peoples R China
[5] Macau Univ Sci & Technol, Inst Syst Engn, Macau, Peoples R China
[6] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[7] Commun Univ China, Key Lab Media Audio & Video, Minist Educ, Beijing 100024, Peoples R China
基金
中国国家自然科学基金;
关键词
Ensemble learning; Training; Neurons; Machine learning; Dendrites (neurons); Computational modeling; Media; Classification; dendritic neuron model (DNM); ensemble learning; interpretability diversity; random forest (RF); NETWORKS;
D O I
10.1109/TNNLS.2023.3290203
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To construct a strong classifier ensemble, base classifiers should be accurate and diverse. However, there is no uniform standard for the definition and measurement of diversity. This work proposes a learners' interpretability diversity (LID) to measure the diversity of interpretable machine learners. It then proposes a LID-based classifier ensemble. Such an ensemble concept is novel because: 1) interpretability is used as an important basis for diversity measurement and 2) before its training, the difference between two interpretable base learners can be measured. To verify the proposed method's effectiveness, we choose a decision-tree-initialized dendritic neuron model (DDNM) as a base learner for ensemble design. We apply it to seven benchmark datasets. The results show that the DDNM ensemble combined with LID obtains superior performance in terms of accuracy and computational efficiency compared to some popular classifier ensembles. A random-forest-initialized dendritic neuron model (RDNM) combined with LID is an outstanding representative of the DDNM ensemble.
引用
收藏
页码:15896 / 15909
页数:14
相关论文
共 27 条
  • [1] Interpretability Diversity for Decision-Tree-Initialized Dendritic Neuron Model Ensemble
    Luo, Xudong
    Ye, Long
    Liu, Xiaolan
    Wen, Xiaohao
    Zhou, Mengchu
    Zhang, Qin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 15896 - 15909
  • [2] Decision-Tree-Initialized Dendritic Neuron Model for Fast and Accurate Data Classification
    Luo, Xudong
    Wen, Xiaohao
    Zhou, MengChu
    Abusorrah, Abdullah
    Huang, Lukui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) : 4173 - 4183
  • [3] Structural diversity for decision tree ensemble learning
    Tao Sun
    Zhi-Hua Zhou
    Frontiers of Computer Science, 2018, 12 : 560 - 570
  • [4] Structural diversity for decision tree ensemble learning
    Sun, Tao
    Zhou, Zhi-Hua
    FRONTIERS OF COMPUTER SCIENCE, 2018, 12 (03) : 560 - 570
  • [5] A neuron model with synaptic nonlinearities in a dendritic tree for liver disorders
    Jiang, Tao
    Gao, Shangce
    Wang, Dizhou
    Ji, Junkai
    Todo, Yuki
    Tang, Zheng
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2017, 12 (01) : 105 - 115
  • [6] A Decision Tree Ensemble Model for Predicting Bus Bunching
    Santos, Veruska Borges
    Pires, Carlos Eduardo S.
    Nascimento, Dimas Cassimiro
    de Queiroz, Andreza Raquel M.
    COMPUTER JOURNAL, 2022, 65 (08): : 2044 - 2062
  • [7] An Interpretability Evaluation Framework for Decision Tree Surrogate Model-Based XAIs
    Yang, Xinyue
    Huang, Hai
    Zuo, Xingquan
    FRONTIERS OF ARTIFICIAL INTELLIGENCE, ETHICS, AND MULTIDISCIPLINARY APPLICATIONS, FAIEMA 2023, 2024, : 99 - 112
  • [8] Using decision tree models and diversity measures in the selection of ensemble classification models
    Gal-Or, M
    May, JH
    Spangler, WE
    MULTIPLE CLASSIFIER SYSTEMS, 2005, 3541 : 186 - 195
  • [9] An ensemble learning model based on differentially private decision tree
    Niu, Xufeng
    Ma, Wenping
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) : 5267 - 5280
  • [10] An ensemble learning model based on differentially private decision tree
    Xufeng Niu
    Wenping Ma
    Complex & Intelligent Systems, 2023, 9 : 5267 - 5280