Neural-Based Video Compression on Solar Dynamics Observatory Images

被引:0
|
作者
Khoshkhahtinat, Atefeh [1 ]
Zafari, Ali [1 ]
Mehta, Piyush M. [1 ]
Nasrabadi, Nasser M. [1 ]
Thompson, Barbara J. [2 ]
Kirk, Michael S. F. [2 ]
da Silva, Daniel E. [2 ]
机构
[1] West Virginia Univ, Morgantown, WV 26506 USA
[2] NASA Goddard Space Flight Ctr, Greenbelt, MD 20771 USA
基金
美国国家航空航天局;
关键词
Entropy; Image coding; Decoding; Video compression; Adaptation models; Transform coding; Context modeling; Entropy model; neural video compression; Solar Dynamics Observatory (SDO); transformer;
D O I
10.1109/TAES.2024.3409524
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
NASA's Solar Dynamics Observatory (SDO) mission collects extensive data to monitor the Sun's daily activity. In the realm of space mission design, data compression plays a crucial role in addressing the challenges posed by limited telemetry rates. The primary objective of data compression is to facilitate efficient data management and transmission to work within the constrained bandwidth, thereby ensuring that essential information is captured while optimizing the utilization of available resources. This article introduces a neural video compression technique that achieves a high compression ratio for the SDO's image data collection. The proposed approach focuses on leveraging both temporal and spatial redundancies in the data, leading to a more efficient compression. In this work, we introduce an architecture based on the transformer model, which is specifically designed to capture both local and global information from input images in an effective and efficient manner. In addition, our network is equipped with an entropy model that can accurately model the probability distribution of the latent representations and improves the speed of the entropy decoding step. The entropy model leverages a channel-dependent approach and utilizes checkerboard-shaped local and global spatial contexts. By combining the transformer-based video compression network with our entropy model, the proposed compression algorithm demonstrates superior performance over traditional video codecs like H.264 and H.265, as confirmed by our experimental results.
引用
收藏
页码:6685 / 6701
页数:17
相关论文
共 50 条
  • [1] Neural-Based Compression Scheme for Solar Image Data
    Zafari, Ali
    Khoshkhahtinat, Atefeh
    Grajeda, Jeremy A.
    Mehta, Piyush M.
    Nasrabadi, Nasser M.
    Boucheron, Laura E.
    Thompson, Barbara J.
    Kirk, Michael S. F.
    da Silva, Daniel E.
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (01) : 918 - 933
  • [2] Image and Video Compression With Neural Networks: A Review
    Ma, Siwei
    Zhang, Xinfeng
    Jia, Chuanmin
    Zhao, Zhenghui
    Wang, Shiqi
    Wang, Shanshe
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (06) : 1683 - 1698
  • [3] Spatial Decomposition and Temporal Fusion Based Inter Prediction for Learned Video Compression
    Sheng, Xihua
    Li, Li
    Liu, Dong
    Li, Houqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6460 - 6473
  • [4] End-to-End Neural Video Compression: A Review
    Gomes, Jiovana S.
    Grellert, Mateus
    Ramos, Fabio L. L.
    Bampi, Sergio
    IEEE OPEN JOURNAL OF CIRCUITS AND SYSTEMS, 2025, 6 : 120 - 134
  • [5] Neural Video Compression Based on PVQ Algorithm
    Knop, Michal
    Kapuscinski, Tomasz
    Angryk, Rafal
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2017, PT I, 2017, 10245 : 544 - 551
  • [6] Hierarchical Random Access Coding for Deep Neural Video Compression
    Thang, Nguyen Van
    Bang, Le Van
    IEEE ACCESS, 2023, 11 : 57494 - 57502
  • [7] DeepCoder: A Deep Neural Network Based Video Compression
    Chen, Tong
    Liu, Haojie
    Shen, Qiu
    Yue, Tao
    Cao, Xun
    Ma, Zhan
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [8] Insights From Generative Modeling for Neural Video Compression
    Yang, Ruihan
    Yang, Yibo
    Marino, Joseph
    Mandt, Stephan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 9908 - 9921
  • [9] Neural networks for image and video compression
    Gorodilov, Artem
    Gavrilov, Dmitriy
    Schelkunov, Dmitriy
    2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE: APPLICATIONS AND INNOVATIONS (IC-AIAI), 2018, : 37 - 41
  • [10] A Co-Prediction-Based Compression Scheme for Correlated Images
    Yin, Wenbin
    Shi, Yunhui
    Zuo, Wangmeng
    Fan, Xiaopeng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (08) : 1917 - 1928