Neural-Based Video Compression on Solar Dynamics Observatory Images

被引:0
|
作者
Khoshkhahtinat, Atefeh [1 ]
Zafari, Ali [1 ]
Mehta, Piyush M. [1 ]
Nasrabadi, Nasser M. [1 ]
Thompson, Barbara J. [2 ]
Kirk, Michael S. F. [2 ]
da Silva, Daniel E. [2 ]
机构
[1] West Virginia Univ, Morgantown, WV 26506 USA
[2] NASA Goddard Space Flight Ctr, Greenbelt, MD 20771 USA
基金
美国国家航空航天局;
关键词
Entropy; Image coding; Decoding; Video compression; Adaptation models; Transform coding; Context modeling; Entropy model; neural video compression; Solar Dynamics Observatory (SDO); transformer;
D O I
10.1109/TAES.2024.3409524
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
NASA's Solar Dynamics Observatory (SDO) mission collects extensive data to monitor the Sun's daily activity. In the realm of space mission design, data compression plays a crucial role in addressing the challenges posed by limited telemetry rates. The primary objective of data compression is to facilitate efficient data management and transmission to work within the constrained bandwidth, thereby ensuring that essential information is captured while optimizing the utilization of available resources. This article introduces a neural video compression technique that achieves a high compression ratio for the SDO's image data collection. The proposed approach focuses on leveraging both temporal and spatial redundancies in the data, leading to a more efficient compression. In this work, we introduce an architecture based on the transformer model, which is specifically designed to capture both local and global information from input images in an effective and efficient manner. In addition, our network is equipped with an entropy model that can accurately model the probability distribution of the latent representations and improves the speed of the entropy decoding step. The entropy model leverages a channel-dependent approach and utilizes checkerboard-shaped local and global spatial contexts. By combining the transformer-based video compression network with our entropy model, the proposed compression algorithm demonstrates superior performance over traditional video codecs like H.264 and H.265, as confirmed by our experimental results.
引用
收藏
页码:6685 / 6701
页数:17
相关论文
共 50 条
  • [21] Lossy compression of high dynamic range images and video
    Mantiuk, Rafal
    Myszkowski, Karol
    Seidel, Hans-Peter
    HUMAN VISION AND ELECTRONIC IMAGING XI, 2006, 6057
  • [22] Neural Network-Based Video Compression Artifact Reduction Using Temporal Correlation and Sparsity Prior Predictions
    Chen, Wei-Gang
    Yu, Runyi
    Wang, Xun
    IEEE ACCESS, 2020, 8 : 162479 - 162490
  • [23] An Optimized Framework of Video Compression Using Deep Convolutional Neural Networks (DCNN)
    Sreelatha, M.
    Tulasi, R. Lakshmi
    Kumar, K. Siva
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2022, 22 (05): : 515 - 522
  • [24] Neural Video Compression with Spatio-Temporal Cross-Covariance Transformers
    Chen, Zhenghao
    Relic, Lucas
    Azevedo, Roberto
    Zhang, Yang
    Gross, Markus
    Xu, Dong
    Zhou, Luping
    Schroers, Christopher
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 8543 - 8551
  • [25] Comprehensive Analysis of Flow Incorporated Neural Network based Lightweight Video Compression Architecture
    Sangeeta
    Gulia, Preeti
    Gill, Nasib Singh
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (03) : 503 - 508
  • [26] Immersive Video Compression using Implicit Neural Representations
    Kwan, Ho Man
    Zhang, Fan
    Gower, Andrew
    Bull, David
    2024 PICTURE CODING SYMPOSIUM, PCS 2024, 2024,
  • [27] VQNeRV: Vector Quantization Neural Representation for Video Compression
    Zhang, Gai
    Tang, Lv
    Zhang, Xinfeng
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [28] Multiscale convolutional neural-based transformer network for time series prediction
    Wang, Zhixing
    Guan, Yepeng
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (02) : 1015 - 1025
  • [29] Multiscale convolutional neural-based transformer network for time series prediction
    Zhixing Wang
    Yepeng Guan
    Signal, Image and Video Processing, 2024, 18 : 1015 - 1025
  • [30] Video compression with wavelets and random neural network approximations
    Hai, F
    Hussain, K
    Gelenbe, E
    Guha, R
    APPLICATIONS OF ARTIFICIAL NEURAL NETWORKS IN IMAGE PROCESSING VI, 2001, 4305 : 57 - 64