Research on Parallelization of Logsf Feature Selection Algorithm

被引:0
|
作者
Guo, Aizhang [1 ]
Zhang, Ningning [1 ]
Sun, Tao [1 ]
机构
[1] Qilu Univ Technol, Sch Informat, Tinan, Peoples R China
来源
PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018) | 2018年
关键词
Hadoop; feature selection; local learning; Logsf algorithm; MapReduce; EIGENFACES;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advent of the large data age, it is becoming more and more important to reduce the dimension of data. As a common means of data reduction preprocessing, feature selection has attracted more and more attention in recent years. At present, it is mainly based on the traditional feature selection algorithm, but the traditional method has been unable to meet the requirements of massive high-dimensional data processing. So, this paper studies the Logsf feature selection algorithm based on local learning, and improves the shortcomings of the existing algorithm. Then, by using the Mapreduce framework in the Hadoop platform, the improved Logsf feature selection algorithm is designed and implemented in parallel. Finally, the experimental results show that the improved Logsf feature selection algorithm for parallel processing is superior to the existing Logsf feature selection algorithm in the accuracy and the speedup. It fully shows that the characteristics of the parallel Logsf algorithm has a good reliability in this paper.
引用
收藏
页码:2143 / 2147
页数:5
相关论文
共 50 条
  • [21] New Approaches to Parallelization in Filters Aggregation Based Feature Selection Algorithms
    Smetannikov, Ivan
    Isaev, Ilya
    Filchenkov, Andrey
    5TH INTERNATIONAL YOUNG SCIENTIST CONFERENCE ON COMPUTATIONAL SCIENCE, YSC 2016, 2016, 101 : 45 - 52
  • [22] Research on Feature Selection Algorithm Based on Relief-F and Genetic Algorithm for Underwater Target
    Ji, Yong-qiang
    Xu, Gao-zheng
    Han, Peng
    Xie, Lan
    Zhang, Xin
    2018 INTERNATIONAL CONFERENCE ON ELECTRICAL, CONTROL, AUTOMATION AND ROBOTICS (ECAR 2018), 2018, 307 : 407 - 412
  • [23] Feature Selection Using Genetic Algorithm for Big Data
    Saidi, Rania
    Ncir, Waad Bouaguel
    Essoussi, Nadia
    INTERNATIONAL CONFERENCE ON ADVANCED MACHINE LEARNING TECHNOLOGIES AND APPLICATIONS (AMLTA2018), 2018, 723 : 352 - 361
  • [24] Research on parallelization of Apriori algorithm in association rule mining
    Wang, Huan-Bin
    Gao, Yang-Jun
    PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE OF INFORMATION AND COMMUNICATION TECHNOLOGY, 2021, 183 : 641 - 647
  • [25] Research on the ensemble learning classification algorithm based on the novel feature selection method
    Yao Ming-hai
    Wang Na
    2013 IEEE INTERNATIONAL CONFERENCE ON VEHICULAR ELECTRONICS AND SAFETY (ICVES), 2013, : 263 - 267
  • [26] Classification Algorithm Based on Feature Selection and Samples Selection
    Xu, Yitian
    Zhen, Ling
    Yang, Liming
    Wang, Laisheng
    ADVANCES IN NEURAL NETWORKS - ISNN 2009, PT 2, PROCEEDINGS, 2009, 5552 : 631 - 638
  • [27] Rank Aggregation Algorithm Selection Meets Feature Selection
    Zabashta, Alexey
    Smetannikov, Ivan
    Filchenkov, Andrey
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION (MLDM 2016), 2016, 9729 : 740 - 755
  • [28] A Novel Memetic Feature Selection Algorithm
    Montazeri, Mohadeseh
    Naji, Hamid Reza
    Montazeri, Mitra
    Faraahi, Ahmad
    2013 5TH CONFERENCE ON INFORMATION AND KNOWLEDGE TECHNOLOGY (IKT), 2013, : 295 - 300
  • [29] An improved Dragonfly Algorithm for feature selection
    Hammouri, Abdelaziz, I
    Mafarja, Majdi
    Al-Betar, Mohammed Azmi
    Awadallah, Mohammed A.
    Abu-Doush, Iyad
    KNOWLEDGE-BASED SYSTEMS, 2020, 203
  • [30] A novel hybrid algorithm for feature selection
    Yuefeng Zheng
    Ying Li
    Gang Wang
    Yupeng Chen
    Qian Xu
    Jiahao Fan
    Xueting Cui
    Personal and Ubiquitous Computing, 2018, 22 : 971 - 985