Exabiome: Advancing Microbial Science through Exascale Computing

被引:0
作者
Hofmeyr, Steven [1 ]
Buluc, Aydin [1 ]
Riley, Robert [2 ]
Egan, Rob [2 ]
Selvitopi, Oguz [1 ]
Oliker, Leonid [3 ]
Yelick, Katherine [1 ]
Shakya, Migun [4 ]
Youtsey, Brett [4 ]
Azad, Ariful [5 ]
机构
[1] Lawrence Berkeley Natl Lab, Berkeley, CA 94720 USA
[2] Lawrence Berkeley Natl Lab, US Dept Energy Joint Genome Inst, Berkeley, CA 94720 USA
[3] Lawrence Berkeley Natl Lab, Performance & Algorithms Res Grp, Berkeley, CA 94720 USA
[4] Los Alamos Natl Lab, Biosci Div, Los Alamos, NM 87545 USA
[5] Indiana Univ Bloomington, Dept Intelligent Syst Engn, Bloomington, IN 47405 USA
关键词
Assembly; Protein sequences; Microorganisms; Exascale computing; Sequential analysis; Redox; Microbiology; Metagenomics; Protein engineering;
D O I
10.1109/MCSE.2024.3402546
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The Exabiome project seeks to improve the understanding of microbiomes through the development of methods for accelerating metagenomic science using exascale computing. This article gives an overview of scientific impact of the three components of the project: metagenome assembly, protein family detection, and comparative analysis of metagenomes. Exabiome developed MetaHipMer, the only metagenome assembler capable of scaling to full exascale systems. MetaHipMer has enabled ground-breaking assemblies on the Frontier supercomputer, with many scientific benefits, such as the discovery of rare species and viral genomes. To investigate protein families, Exabiome developed two exascale tools, PASTIS and HipMCL. Together, these can utilize exascale resources to understand the functional diversity of billions of "dark matter" proteins and novel protein families. For comparative analysis, Exabiome developed kmerprof, a tool that can be used to compare huge metagenomes for many different scientific purposes, for example, grouping human microbiomes according to body location.
引用
收藏
页码:8 / 15
页数:8
相关论文
共 12 条
[1]  
[Anonymous], NIH Human Microbiome Project defines normal bacterial makeup of the body | National Institutes of Health (NIH)
[2]  
[Anonymous], Tara oceans: An expedition to the heart of the biodiversity of the world of plankton, the ocean under the microscope
[3]   Combinatorial BLAS 2.0: Scaling Combinatorial Algorithms on Distributed-Memory Systems [J].
Azad, Ariful ;
Selvitopi, Oguz ;
Hussain, Md Taufique ;
Gilbert, John R. ;
Buluc, Aydin .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (04) :989-1001
[4]   HipMCL: a high-performance parallel implementation of the Markov clustering algorithm for large-scale networks [J].
Azad, Ariful ;
Pavlopoulos, Georgios A. ;
Ouzounis, Christos A. ;
Kyrpides, Nikos C. ;
Buluc, Aydin .
NUCLEIC ACIDS RESEARCH, 2018, 46 (06) :E33
[5]   UPC plus plus : A High-Performance Communication Framework for Asynchronous Computation [J].
Bachan, John ;
Baden, Scott B. ;
Hofmeyr, Steven ;
Jacquelin, Mathias ;
Kamil, Amir ;
Bonachea, Dan ;
Hargrove, Paul H. ;
Ahmed, Hadia .
2019 IEEE 33RD INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2019), 2019, :963-973
[6]   How to apply de Bruijn graphs to genome assembly [J].
Compeau, Phillip E. C. ;
Pevzner, Pavel A. ;
Tesler, Glenn .
NATURE BIOTECHNOLOGY, 2011, 29 (11) :987-991
[7]   Terabase-scale metagenome coassembly with MetaHipMer [J].
Hofmeyr, Steven ;
Egan, Rob ;
Georganas, Evangelos ;
Copeland, Alex C. ;
Riley, Robert ;
Clum, Alicia ;
Eloe-Fadrosh, Emiley ;
Roux, Simon ;
Goltsman, Eugene ;
Buluc, Aydin ;
Rokhsar, Daniel ;
Oliker, Leonid ;
Yelick, Katherine .
SCIENTIFIC REPORTS, 2020, 10 (01)
[8]   Critical Assessment of Metagenome Interpretation: the second round of challenges [J].
Meyer, Fernando ;
Fritz, Adrian ;
Deng, Zhi-Luo ;
Koslicki, David ;
Lesker, Till Robin ;
Gurevich, Alexey ;
Robertson, Gary ;
Alser, Mohammed ;
Antipov, Dmitry ;
Beghini, Francesco ;
Bertrand, Denis ;
Brito, Jaqueline J. ;
Brown, C. Titus ;
Buchmann, Jan ;
Buluc, Aydin ;
Chen, Bo ;
Chikhi, Rayan ;
Clausen, Philip T. L. C. ;
Cristian, Alexandru ;
Dabrowski, Piotr Wojciech ;
Darling, Aaron E. ;
Egan, Rob ;
Eskin, Eleazar ;
Georganas, Evangelos ;
Goltsman, Eugene ;
Gray, Melissa A. ;
Hansen, Lars Hestbjerg ;
Hofmeyr, Steven ;
Huang, Pingqin ;
Irber, Luiz ;
Jia, Huijue ;
Jorgensen, Tue Sparholt ;
Kieser, Silas D. ;
Klemetsen, Terje ;
Kola, Axel ;
Kolmogorov, Mikhail ;
Korobeynikov, Anton ;
Kwan, Jason ;
LaPierre, Nathan ;
Lemaitre, Claire ;
Li, Chenhao ;
Limasset, Antoine ;
Malcher-Miranda, Fabio ;
Mangul, Serghei ;
Marcelino, Vanessa R. ;
Marchet, Camille ;
Marijon, Pierre ;
Meleshko, Dmitry ;
Mende, Daniel R. ;
Milanese, Alessio .
NATURE METHODS, 2022, 19 (04) :429-+
[9]   Unraveling the functional dark matter through global metagenomics [J].
Pavlopoulos, Georgios A. ;
Baltoumas, Fotis A. ;
Liu, Sirui ;
Selvitopi, Oguz ;
Camargo, Antonio Pedro ;
Nayfach, Stephen ;
Azad, Ariful ;
Roux, Simon ;
Call, Lee ;
Ivanova, Natalia N. ;
Chen, I. Min ;
Paez-Espino, David ;
Karatzas, Evangelos ;
Iliopoulos, Ioannis ;
Konstantinidis, Konstantinos ;
Tiedje, James M. ;
Pett-Ridge, Jennifer ;
Baker, David ;
Visel, Axel ;
Ouzounis, Christos A. ;
Ovchinnikov, Sergey ;
Buluc, Aydin ;
Kyrpides, Nikos C. .
NATURE, 2023, 622 (7983) :594-+
[10]   Terabase-Scale Coassembly of a Tropical Soil Microbiome [J].
Riley, Robert ;
Bowers, Robert M. ;
Camargo, Antonio Pedro ;
Campbell, Ashley ;
Egan, Rob ;
Eloe-Fadrosh, Emiley A. ;
Foster, Brian ;
Hofmeyr, Steven ;
Huntemann, Marcel ;
Kellom, Matthew ;
Kimbrel, Jeffrey A. ;
Oliker, Leonid ;
Yelick, Katherine ;
Pett-Ridge, Jennifer ;
Salamov, Asaf ;
Varghese, Neha J. ;
Clum, Alicia .
MICROBIOLOGY SPECTRUM, 2023, 11 (04)