Adaptive differentiable grids for cryo-electron tomography reconstruction and denoising

Motivation Tilt-series cryo-electron tomography is a powerful tool widely used in structural biology to study 3D structures of micro-organisms, macromolecular complexes, etc. Still, the reconstruction process remains an arduous task due to several challenges: The missing-wedge acquisition, sample misalignment and motion, the need to process large data, and, especially, a low signal-to-noise ratio.Results Inspired by the recently introduced neural representations, we propose an adaptive learning-based representation of the density field of the captured sample. This representation consists of an octree structure, where each node represents a 3D density grid optimized from the captured projections during the training process. This optimization is performed using a loss that combines a differentiable image formation model with different regularization terms: total variation, boundary consistency, and a cross-nodes non-local constraint. The final reconstruction is obtained by interpolating the learned density grid at the desired voxel positions. The evaluation of our approach using captured data of viruses and cells shows that our proposed representation is well adapted to handle missing wedges, and improves the signal-to-noise ratio of the reconstructed tomogram. The reconstruction quality is highly improved in comparison to the state-of-the-art methods, while using the lowest computing time footprint.Availability and implementation The code is available on Github at https://github.com/yuanhaowang1213/adaptivediffgrid_ex.