Research on Parallelization of Logsf Feature Selection Algorithm

被引:0
|
作者
Guo, Aizhang [1 ]
Zhang, Ningning [1 ]
Sun, Tao [1 ]
机构
[1] Qilu Univ Technol, Sch Informat, Tinan, Peoples R China
来源
PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018) | 2018年
关键词
Hadoop; feature selection; local learning; Logsf algorithm; MapReduce; EIGENFACES;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advent of the large data age, it is becoming more and more important to reduce the dimension of data. As a common means of data reduction preprocessing, feature selection has attracted more and more attention in recent years. At present, it is mainly based on the traditional feature selection algorithm, but the traditional method has been unable to meet the requirements of massive high-dimensional data processing. So, this paper studies the Logsf feature selection algorithm based on local learning, and improves the shortcomings of the existing algorithm. Then, by using the Mapreduce framework in the Hadoop platform, the improved Logsf feature selection algorithm is designed and implemented in parallel. Finally, the experimental results show that the improved Logsf feature selection algorithm for parallel processing is superior to the existing Logsf feature selection algorithm in the accuracy and the speedup. It fully shows that the characteristics of the parallel Logsf algorithm has a good reliability in this paper.
引用
收藏
页码:2143 / 2147
页数:5
相关论文
共 50 条
  • [31] Binary Dragonfly Algorithm for Feature Selection
    Mafarja, Majdi M.
    Eleyan, Derar
    Jaber, Iyad
    Mirjalili, Seyedali
    Hammouri, Abdelaziz
    2017 INTERNATIONAL CONFERENCE ON NEW TRENDS IN COMPUTING SCIENCES (ICTCS), 2017, : 12 - 17
  • [32] FREL: A Stable Feature Selection Algorithm
    Li, Yun
    Si, Jennie
    Zhou, Guojing
    Huang, Shasha
    Chen, Songcan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (07) : 1388 - 1402
  • [33] Feature selection algorithm and cobweb correlation
    Klimesova, D
    Saic, S
    PATTERN RECOGNITION LETTERS, 1998, 19 (08) : 681 - 685
  • [34] Feature selection algorithm based on SVM
    Sun Jiongjiong
    Liu Jun
    Wei Xuguang
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 4113 - 4116
  • [35] Stability of feature selection algorithm: A review
    Khaire, Utkarsh Mahadeo
    Dhanalakshmi, R.
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (04) : 1060 - 1073
  • [36] Exploration of a hybrid feature selection algorithm
    Osei-Bryson, KM
    Giles, K
    Kositanurit, B
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2003, 54 (07) : 790 - 797
  • [37] A novel hybrid algorithm for feature selection
    Zheng, Yuefeng
    Li, Ying
    Wang, Gang
    Chen, Yupeng
    Xu, Qian
    Fan, Jiahao
    Cui, Xueting
    PERSONAL AND UBIQUITOUS COMPUTING, 2018, 22 (5-6) : 971 - 985
  • [38] Feature Selection Algorithm Based on LightGBM
    Li Z.-S.
    Yao X.
    Liu Z.-G.
    Zhang J.-C.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2021, 42 (12): : 1688 - 1695
  • [39] Feature selection algorithm based on XGBoost
    Li Z.
    Liu Z.
    Tongxin Xuebao/Journal on Communications, 2019, 40 (10): : 101 - 108
  • [40] A Hybrid Algorithm for Feature Selection and Classification
    Sathish, B. R.
    Senthilkumar, Radha
    JOURNAL OF INTERNET TECHNOLOGY, 2023, 24 (03): : 593 - 602