First steps into the cloud: Using Amazon data storage and computing with Python']Python notebooks

被引:0
作者
Pollak, Daniel J. [1 ,2 ]
Chawla, Gautam [1 ,2 ]
Andreev, Andrey [1 ,2 ]
Prober, David A. [1 ,2 ]
机构
[1] CALTECH, Div Biol & Biol Engn, Pasadena, CA 91125 USA
[2] CALTECH, Tianqiao & Chrissy Chen Inst Neurosci, Pasadena, CA 91125 USA
关键词
D O I
10.1371/journal.pone.0278316
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
With the oncoming age of big data, biologists are encountering more use cases for cloud-based computing to streamline data processing and storage. Unfortunately, cloud platforms are difficult to learn, and there are few resources for biologists to demystify them. We have developed a guide for experimental biologists to set up cloud processing on Amazon Web Services to cheaply outsource data processing and storage. Here we provide a guide for setting up a computing environment in the cloud and showcase examples of using Python and Julia programming languages. We present example calcium imaging data in the zebrafish brain and corresponding analysis using suite2p software. Tools for budget and user management are further discussed in the attached protocol. Using this guide, researchers with limited coding experience can get started with cloud-based computing or move existing coding infrastructure into the cloud environment.
引用
收藏
页数:9
相关论文
共 5 条
[1]  
Andreev A, 2020, Microscopy Today, V28, P42, DOI [10.1017/s1551929520001091, 10.1017/S1551929520001091, DOI 10.1017/S1551929520001091]
[2]  
Bezanson J, 2012, Arxiv, DOI [arXiv:1209.5145, DOI 10.48550/ARXIV.1209.5145]
[3]   Array programming with NumPy [J].
Harris, Charles R. ;
Millman, K. Jarrod ;
van der Walt, Stefan J. ;
Gommers, Ralf ;
Virtanen, Pauli ;
Cournapeau, David ;
Wieser, Eric ;
Taylor, Julian ;
Berg, Sebastian ;
Smith, Nathaniel J. ;
Kern, Robert ;
Picus, Matti ;
Hoyer, Stephan ;
van Kerkwijk, Marten H. ;
Brett, Matthew ;
Haldane, Allan ;
del Rio, Jaime Fernandez ;
Wiebe, Mark ;
Peterson, Pearu ;
Gerard-Marchant, Pierre ;
Sheppard, Kevin ;
Reddy, Tyler ;
Weckesser, Warren ;
Abbasi, Hameer ;
Gohlke, Christoph ;
Oliphant, Travis E. .
NATURE, 2020, 585 (7825) :357-362
[4]   A versatile, multi-laser twin-microscope system for light-sheet imaging [J].
Keomanee-Dizon, Kevin ;
Fraser, Scott E. ;
Truong, Thai V. .
REVIEW OF SCIENTIFIC INSTRUMENTS, 2020, 91 (05)
[5]  
2016, bioRxiv, DOI [10.1101/061507, DOI 10.1101/061507, 10.1101/061507]