HIGH-PERFORMANCE COMPUTING WEB SEARCH SYSTEM BASED ON COMPUTER BIG DATA

被引:0
|
作者
KANG Y. [1 ]
TANG B. [1 ]
HU X. [1 ]
机构
[1] Hunan Institute of Engineering, Hunan, Xiangtan
来源
Scalable Comput. Pract. Exp. | / 3卷 / 1932-1939期
关键词
Distributed hash table; Node cluster; Node proximity; Overlay Network; Topological induction; Topology aware node aggregation algorithm;
D O I
10.12694/SCPE.V25I3.2794
中图分类号
学科分类号
摘要
File sharing, streaming media, collaborative computing, and other P2P systems are all unicast to establish the corresponding overlapping network. The superimposed network is generally carried out based on the existing primary network. In this way, the access of each node is random. At the same time, this will cause the topological structure of the upper and lower layers to be inconsistent. This will increase the communication delay between nodes and cause an excellent bandwidth burden to the underlying network. The existing topology matching methods still face problems, such as poor scalability and long node aggregation time. This paper aims to design a topological distributed node aggregation method based on network coordination and distributed hash table (DHT) algorithm. This paper established a two-dimensional mesh model of nodes based on equal-distance concentric circles and divided into two equal areas. The parts of multiple namespaces correspond one by one according to their location. Because nodes are kept close, neighbours can be aggregated through DHT’s primary ”publish” and ”search” primitives. Experimental results show that the TANRA method can match the network’s topology under a slight delay and a large number of nodes. The TANRA method can effectively reduce the path delay in structured networks. © (2024) West University of Timisoara.
引用
收藏
页码:1932 / 1939
页数:7
相关论文
共 50 条
  • [1] HIGH-PERFORMANCE COMPUTING WEB SEARCH SYSTEM BASED ON COMPUTER BIG DATA
    Kang, Yingxi
    Tang, Beiping
    Hu, Xiaodong
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (03): : 1932 - 1939
  • [2] RESEARCH ON HIGH-PERFORMANCE COMPUTING NETWORK SEARCH SYSTEM BASED ON COMPUTER BIG DATA
    Chen, Xiaogang
    Liu, Dongmei
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (03): : 1833 - 1840
  • [3] RESEARCH ON HIGH-PERFORMANCE COMPUTING NETWORK SEARCH SYSTEM BASED ON COMPUTER BIG DATA
    Chen X.
    Liu D.
    Scalable Computing, 2024, 25 (03): : 1833 - 1840
  • [4] A High Performance Computing Web Search Engine Based on Big Data and Parallel Distributed Models
    Ma, Jun
    Informatica (Slovenia), 2024, 48 (20): : 27 - 38
  • [5] Heterogeneous High-Performance System Algorithm Based on Computer Big Data Technology
    Pan, Dongyang
    EAI ENDORSED TRANSACTIONS ON SCALABLE INFORMATION SYSTEMS, 2024, 11 (01)
  • [6] Contributions to High-Performance Big Data Computing
    Fox, Geoffrey
    Qiu, Judy
    Crandall, David
    Von Laszewski, Gregor
    Beckstein, Oliver
    Paden, John
    Paraskevakos, Ioannis
    Jha, Shantenu
    Wang, Fusheng
    Marathe, Madhav
    Vullikanti, Anil
    Cheatham, Thomas
    FUTURE TRENDS OF HPC IN A DISRUPTIVE SCENARIO, 2019, 34 : 34 - 81
  • [7] High-Performance Computing for Big Data Processing
    Wu, Yulei
    Xiang, Yang
    Ge, Jingguo
    Muller, Peter
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 88 : 693 - 695
  • [8] High-Performance Computing and Big Data in Omics-Based Medicine
    Merelli, Ivan
    Perez-Sanchez, Horacio
    Gesing, Sandra
    D'Agostino, Daniele
    BIOMED RESEARCH INTERNATIONAL, 2014, 2014
  • [9] HIGH-PERFORMANCE COMPUTING BASED BIG DATA ANALYTICS FOR SMART MANUFACTURING
    Yang, Yuhang
    Cai, Y. Dora
    Lu, Qiyue
    Zhang, Yifang
    Koric, Seid
    Shao, Chenhui
    PROCEEDINGS OF THE ASME 13TH INTERNATIONAL MANUFACTURING SCIENCE AND ENGINEERING CONFERENCE, 2018, VOL 3, 2018,
  • [10] Perspectives on High-Performance Computing in a Big Data World
    Fox, Geoffrey C.
    HPDC'19: PROCEEDINGS OF THE 28TH INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING, 2019, : 145 - 145