A Distributed Framework for Large-scale Protein-protein Interaction Data Analysis and Prediction Using MapReduce

被引:53
作者
Hu, Lun [1 ,5 ]
Yang, Shicheng [2 ]
Luo, Xin [1 ,3 ,4 ]
Yuan, Huaqiang [1 ]
Sedraoui, Khaled [6 ,7 ]
Zhou, MengChu [8 ]
机构
[1] Dongguan Univ Technol, Sch Comp Sci & Technol, Dongguan 523808, Peoples R China
[2] Wuhan Univ Technol, Sch Comp Sci & Technol, Wuhan 430070, Hubei, Peoples R China
[3] Chongqing Inst Green & Intelligent Technol, Chongqing Engn Res Ctr Big Data Applicat Smart Ci, Chongqing 400714, Peoples R China
[4] Chongqing Inst Green & Intelligent Technol, Chongqing Key Lab Big Data & Intelligent Comp, Chinese Acad Sci, Chongqing 400714, Peoples R China
[5] Xinjiang Tech Inst Phys & Chem, Chinese Acad Sci, Urumqi 830000, Peoples R China
[6] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Jeddah 21589, Saudi Arabia
[7] King Abdulaziz Univ, Dept Elect & Comp Engn, Fac Engn, Jeddah 21589, Saudi Arabia
[8] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
基金
中国国家自然科学基金;
关键词
Distributed computing; large-scale prediction machine learning; MapReduce; protein-protein interaction (PPI); GENE ORDER; NETWORK; ALGORITHM; INFERENCE; MODEL;
D O I
10.1109/JAS.2021.1004198
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Protein-protein interactions are of great significance for human to understand the functional mechanisms of proteins. With the rapid development of high-throughput genomic technologies, massive protein-protein interaction (PPI) data have been generated, making it very difficult to analyze them efficiently. To address this problem, this paper presents a distributed framework by reimplementing one of state-of-the-art algorithms, i.e., CoFex, using MapReduce. To do so, an in-depth analysis of its limitations is conducted from the perspectives of efficiency and memory consumption when applying it for large-scale PPI data analysis and prediction. Respective solutions are then devised to overcome these limitations. In particular, we adopt a novel tree-based data structure to reduce the heavy memory consumption caused by the huge sequence information of proteins. After that, its procedure is modified by following the MapReduce framework to take the prediction task distributively. A series of extensive experiments have been conducted to evaluate the performance of our framework in terms of both efficiency and accuracy. Experimental results well demonstrate that the proposed framework can considerably improve its computational efficiency by more than two orders of magnitude while retaining the same high accuracy.
引用
收藏
页码:160 / 172
页数:13
相关论文
共 50 条
[31]   ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design [J].
Notin, Pascal ;
Kollasch, Aaron W. ;
Ritter, Daniel ;
van Niekerk, Lood ;
Paul, Steffanie ;
Spinner, Hansen ;
Rollins, Nathan ;
Shaw, Ada ;
Weitzman, Ruben ;
Frazer, Jonathan ;
Dias, Mafalda ;
Franceschi, Dinko ;
Frazer, Jonathan ;
Dias, Mafalda ;
Franceschi, Dinko ;
Orenbuch, Rose ;
Gal, Yarin ;
Marks, Debora S. .
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
[32]   A distributed data management system to support large-scale data analysis [J].
Emara, Tamer Z. ;
Huang, Joshua Zhexue .
JOURNAL OF SYSTEMS AND SOFTWARE, 2019, 148 :105-115
[33]   Determining Protein-Protein Interaction Using Support Vector Machine: A Review [J].
Chakraborty, Arijit ;
Mitra, Sajal ;
De, Debashis ;
Pal, Anindya Jyoti ;
Ghaemi, Ferial ;
Ahmadian, Ali ;
Ferrara, Massimiliano .
IEEE ACCESS, 2021, 9 :12473-12490
[34]   A MapReduce-based artificial bee colony for large-scale data clustering [J].
Banharnsakun, Anan .
PATTERN RECOGNITION LETTERS, 2017, 93 :78-84
[35]   Efficient K-Nearest Neighbor Graph Construction Using MapReduce for Large-Scale Data Sets [J].
Warashina, Tomohiro ;
Aoyama, Kazuo ;
Sawada, Hiroshi ;
Hattori, Takashi .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2014, E97D (12) :3142-3154
[36]   MRA*: Parallel and Distributed Path in Large-Scale Graph Using MapReduce-A* Based Approach [J].
Hamilton Adoni, Wilfried Yves ;
Nahhal, Tarik ;
Aghezzaf, Brahim ;
Elbyed, Abdeltif .
UBIQUITOUS NETWORKING, UNET 2017, 2017, 10542 :390-401
[37]   Evaluation of Physical and Functional Protein-Protein Interaction Prediction Methods for Detecting Biological Pathways [J].
Muley, Vijaykumar Yogesh ;
Ranjan, Akash .
PLOS ONE, 2013, 8 (01)
[38]   Construction and analysis of protein-protein interaction networks based on proteomics data of prostate cancer [J].
Chen, Chen ;
Shen, Hong ;
Zhang, Li-Guo ;
Liu, Jian ;
Cao, Xiao-Ge ;
Yao, An-Liang ;
Kang, Shao-San ;
Gao, Wei-Xing ;
Han, Hui ;
Cao, Feng-Hong ;
Li, Zhi-Guo .
INTERNATIONAL JOURNAL OF MOLECULAR MEDICINE, 2016, 37 (06) :1576-1586
[39]   Design of Large-scale Content-based Recommender System using Hadoop MapReduce Framework [J].
Saravanan, S. .
2015 EIGHTH INTERNATIONAL CONFERENCE ON CONTEMPORARY COMPUTING (IC3), 2015, :302-307
[40]   Boosting Prediction Performance of Protein-Protein Interaction Hot Spots by Using Structural Neighborhood Properties [J].
Deng, Lei ;
Guan, Jihong ;
Wei, Xiaoming ;
Yi, Yuan ;
Zhang, Qiangfeng Cliff ;
Zhou, Shuigeng .
JOURNAL OF COMPUTATIONAL BIOLOGY, 2013, 20 (11) :878-891