Research on Parallelization of Logsf Feature Selection Algorithm

被引:0
|
作者
Guo, Aizhang [1 ]
Zhang, Ningning [1 ]
Sun, Tao [1 ]
机构
[1] Qilu Univ Technol, Sch Informat, Tinan, Peoples R China
来源
PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018) | 2018年
关键词
Hadoop; feature selection; local learning; Logsf algorithm; MapReduce; EIGENFACES;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advent of the large data age, it is becoming more and more important to reduce the dimension of data. As a common means of data reduction preprocessing, feature selection has attracted more and more attention in recent years. At present, it is mainly based on the traditional feature selection algorithm, but the traditional method has been unable to meet the requirements of massive high-dimensional data processing. So, this paper studies the Logsf feature selection algorithm based on local learning, and improves the shortcomings of the existing algorithm. Then, by using the Mapreduce framework in the Hadoop platform, the improved Logsf feature selection algorithm is designed and implemented in parallel. Finally, the experimental results show that the improved Logsf feature selection algorithm for parallel processing is superior to the existing Logsf feature selection algorithm in the accuracy and the speedup. It fully shows that the characteristics of the parallel Logsf algorithm has a good reliability in this paper.
引用
收藏
页码:2143 / 2147
页数:5
相关论文
共 50 条
  • [41] Feature Selection Algorithm for Noise Data
    Xu H.
    Zhang S.-C.
    Wu Z.-J.
    Li J.-Y.
    Zhang, Shi-Chao (zhangsc@csu.edu.cn), 1600, Chinese Academy of Sciences (32): : 3440 - 3451
  • [42] RBFACO: A New Feature Selection Algorithm
    Xiao, Yunshuang
    Chen, Shuyu
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 2884 - 2890
  • [43] An Incremental Algorithm to Feature Selection in Decision Systems with the Variation of Feature
    Qian Wenbin
    Shu Wenhao
    Yang Bingru
    Zhang Changsheng
    CHINESE JOURNAL OF ELECTRONICS, 2015, 24 (01) : 128 - 133
  • [44] A feature selection algorithm of decision tree based on feature weight
    Zhou, HongFang
    Zhang, JiaWei
    Zhou, YueQing
    Guo, XiaoJie
    Ma, YiMing
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 164
  • [45] The Feature Selection Algorithm Based on Feature Overlapping and Group Overlapping
    Lin, Xiaohui
    Song, Huanhuan
    Fan, Meng
    Ren, Weijie
    Li, Lishuang
    Yao, Weihong
    2016 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2016, : 619 - 624
  • [46] New Feature Selection Algorithm Based on Feature Stability and Correlation
    Al-Shalabi, Luai
    IEEE ACCESS, 2022, 10 : 4699 - 4713
  • [47] A Feature Selection Method Based on Feature Grouping and Genetic Algorithm
    Lin, Xiaohui
    Wang, Xiaomei
    Xiao, Niyi
    Huang, Xin
    Wang, Jue
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: BIG DATA AND MACHINE LEARNING TECHNIQUES, ISCIDE 2015, PT II, 2015, 9243 : 150 - 158
  • [48] A Fast Clonal Selection Algorithm for Feature Selection in Hyperspectral Imagery
    Zhong Yanfei
    Zhang Liangpei
    GEO-SPATIAL INFORMATION SCIENCE, 2009, 12 (03) : 172 - 181
  • [49] IMPROVED FORWARD FLOATING SELECTION ALGORITHM FOR FEATURE SUBSET SELECTION
    Nakariyakul, Songyot
    Casasent, David P.
    PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION, VOLS 1 AND 2, 2008, : 793 - +
  • [50] Fast orthogonal forward selection algorithm for feature subset selection
    Mao, KZ
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (05): : 1218 - 1224