Parallel random swap: An efficient and reliable clustering algorithm in java']java

被引:6
作者
Nigro, Libero [1 ]
Cicirelli, Franco [2 ]
Fra, Pasi [3 ]
机构
[1] Univ Calabria, DIMES Dept Informat Modelling Elect & Syst Sci, I-87036 Arcavacata Di Rende, Italy
[2] CNR Natl Res Council Italy, Inst High Performance Comp & Networking ICAR Rende, I-87036 Arcavacata Di Rende, Italy
[3] Univ Eastern Finland, Sch Comp, Machine Learning Grp, POB 111, Joensuu 80101, Finland
关键词
Clustering problem; K; -means; Random swap; Parallelism; !text type='Java']Java[!/text; Streams; Lambda expressions; Actors; Multi -core machines; K-MEANS ALGORITHM; OPTIMIZATION;
D O I
10.1016/j.simpat.2022.102712
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Solving large-scale clustering problems requires an efficient algorithm that can also be implemented in parallel. K-means would be suitable, but it can lead to an inaccurate clustering result. To overcome this problem, we present a parallel version of the random swap clustering algorithm. It combines the scalability of k-means with the high clustering accuracy of random swap. The algorithm is implemented in Java in two ways. The first implementation uses Java parallel streams and lambda expressions. The solution exploits a built-in multi-threaded organization capable of offering competitive speedup. The second implementation is achieved on top of the Theatre actor system which ensures better scalability and high-performance computing through fine-grain resource control. The two implementations are then applied to standard benchmark datasets, with a varying population size and distribution of managed records, dimensionality of data points and the number of clusters. The experimental results confirm that high-quality clustering can be obtained together with a very good execution efficiency. Our Java code is publicly available at: https://github.com/uef-machine-learning.
引用
收藏
页数:17
相关论文
共 40 条
  • [1] Aljarah I, 2012, WOR CONG NAT BIOL, P104, DOI 10.1109/NaBIC.2012.6402247
  • [2] [Anonymous], BENCHMARK DATASETS
  • [3] Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
  • [4] Baldassi C., 2022, IEEE T EVOLUT COMPUT, V20
  • [5] Analyzing stochastic reward nets by model checking and parallel simulation
    Cicirelli, Franco
    Nigro, Libero
    [J]. SIMULATION MODELLING PRACTICE AND THEORY, 2022, 116
  • [6] A GPU-accelerated parallel K-means algorithm
    Cuomo, S.
    De Angelis, V.
    Farina, G.
    Marcellino, L.
    Toraldo, G.
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2019, 75 : 262 - 274
  • [7] Swarm intelligence for clustering - A systematic review with new perspectives on data mining
    Figueiredo, Elliackin
    Macedo, Mariana
    Siqueira, Hugo Valadares
    Santana, Clodomir J., Jr.
    Gokhale, Anu
    Bastos-Filho, Carmelo J. A.
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2019, 82 : 313 - 329
  • [8] Fast and memory efficient implementation of the exact PNN
    Fränti, P
    Kaukoranta, T
    Shen, DF
    Chang, KS
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (05) : 773 - 777
  • [9] Genetic algorithm with deterministic crossover for vector quantization
    Fränti, P
    [J]. PATTERN RECOGNITION LETTERS, 2000, 21 (01) : 61 - 68
  • [10] Franti P., 2022, APPL COMPUTING INTEL, V2, P63