MRCZ - A file format for cryo-TEM data with fast compression

被引:8
作者
McLeod, Robert A. [1 ]
Righetto, Ricardo Diogo [1 ]
Stewart, Andy [2 ]
Stahlberg, Henning [1 ]
机构
[1] Univ Basel, Ctr Cellular Imaging & NanoAnalyt C CINA, Basel, Switzerland
[2] Univ Limerick, Dept Phys, Limerick, Ireland
基金
瑞士国家科学基金会;
关键词
Lossless compression; Data management; File archiving; BEAM-INDUCED MOTION; ELECTRON;
D O I
10.1016/j.jsb.2017.11.012
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
The introduction of fast CMOS detectors is moving the field of transmission electron microscopy into the computer science field of big data. Automated data pipelines control the instrument and initial processing steps which imposes more onerous data transfer and archiving requirements. Here we conduct a technical demonstration whereby storage and read/write times are improved 10 x at a dose rate of 1 e(-)/pix/frame for data from a Gatan K2 direct-detection device by combination of integer decimation and lossless compression. The example project is hosted at github.com/em-MRCZ and released under the BSD license.
引用
收藏
页码:252 / 257
页数:6
相关论文
共 16 条
[1]   A posteriori correction of camera characteristics from large image data sets [J].
Afanasyev, Pavel ;
Ravelli, Raimond B. G. ;
Matadeen, Rishi ;
De Carlo, Sacha ;
van Duinen, Gijs ;
Alewijnse, Bart ;
Peters, Peter J. ;
Abrahams, Jan-Pieter ;
Portugal, Rodrigo V. ;
Schatz, Michael ;
van Heel, Marin .
SCIENTIFIC REPORTS, 2015, 5
[2]  
Alted K., 2014, BLOSC EXTREMELY FAST
[3]  
[Anonymous], GOOGL CLOUD STOR PRI
[4]   MRC2014: Extensions to the MRC format header for electron cryo-microscopy and tomography [J].
Cheng, Anchi ;
Henderson, Richard ;
Mastronarde, David ;
Ludtke, Steven J. ;
Schoenmakers, Remco H. M. ;
Short, Judith ;
Marabini, Roberto ;
Dallakyan, Sargis ;
Agard, David ;
Winn, Martyn .
JOURNAL OF STRUCTURAL BIOLOGY, 2015, 192 (02) :146-150
[5]   MRC image processing programs [J].
Crowther, RA ;
Henderson, R ;
Smith, JM .
JOURNAL OF STRUCTURAL BIOLOGY, 1996, 116 (01) :9-16
[6]  
Duda J, 2013, ARXIV13112540CSMATH
[7]  
Duda J, 2015, 2015 PICTURE CODING SYMPOSIUM (PCS) WITH 2015 PACKET VIDEO WORKSHOP (PV), P65, DOI 10.1109/PCS.2015.7170048
[8]  
ECMA, ECMA-404
[9]   Measuring the optimal exposure for single particle cryo-EM using a 2.6 Å reconstruction of rotavirus VP6 [J].
Grant, Timothy ;
Grigorieff, Nikolaus .
ELIFE, 2015, 4
[10]  
Haenel V., 2014, ARXIV14046383CS