Neural-Based Video Compression on Solar Dynamics Observatory Images

被引:0
|
作者
Khoshkhahtinat, Atefeh [1 ]
Zafari, Ali [1 ]
Mehta, Piyush M. [1 ]
Nasrabadi, Nasser M. [1 ]
Thompson, Barbara J. [2 ]
Kirk, Michael S. F. [2 ]
da Silva, Daniel E. [2 ]
机构
[1] West Virginia Univ, Morgantown, WV 26506 USA
[2] NASA Goddard Space Flight Ctr, Greenbelt, MD 20771 USA
基金
美国国家航空航天局;
关键词
Entropy; Image coding; Decoding; Video compression; Adaptation models; Transform coding; Context modeling; Entropy model; neural video compression; Solar Dynamics Observatory (SDO); transformer;
D O I
10.1109/TAES.2024.3409524
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
NASA's Solar Dynamics Observatory (SDO) mission collects extensive data to monitor the Sun's daily activity. In the realm of space mission design, data compression plays a crucial role in addressing the challenges posed by limited telemetry rates. The primary objective of data compression is to facilitate efficient data management and transmission to work within the constrained bandwidth, thereby ensuring that essential information is captured while optimizing the utilization of available resources. This article introduces a neural video compression technique that achieves a high compression ratio for the SDO's image data collection. The proposed approach focuses on leveraging both temporal and spatial redundancies in the data, leading to a more efficient compression. In this work, we introduce an architecture based on the transformer model, which is specifically designed to capture both local and global information from input images in an effective and efficient manner. In addition, our network is equipped with an entropy model that can accurately model the probability distribution of the latent representations and improves the speed of the entropy decoding step. The entropy model leverages a channel-dependent approach and utilizes checkerboard-shaped local and global spatial contexts. By combining the transformer-based video compression network with our entropy model, the proposed compression algorithm demonstrates superior performance over traditional video codecs like H.264 and H.265, as confirmed by our experimental results.
引用
收藏
页码:6685 / 6701
页数:17
相关论文
共 50 条
  • [31] Digital Video Manipulation Detection Technique Based on Compression Algorithms
    Gonzalez Fernandez, Edgar
    Sandoval Orozco, Ana Lucila
    Garcia Villalba, Luis Javier
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (03) : 2596 - 2605
  • [32] A content-adaptive video compression method based on transformer
    Li, Heting
    Jing, Dongsheng
    He, Ping
    Wu, Jiasheng
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2024, 27 (04) : 495 - 503
  • [33] Deep Learning Based Video Compression
    Ji, Kang Da
    Hlavacs, Helmut
    INTELLIGENT TECHNOLOGIES FOR INTERACTIVE ENTERTAINMENT, INTETAIN 2021, 2022, 429 : 127 - 141
  • [34] Video compression based on frequency sensitivity
    Seo, Guiwon
    Youn, Sungwook
    Lee, Chulhee
    SATELLITE DATA COMPRESSION, COMMUNICATIONS, AND PROCESSING VIII, 2012, 8514
  • [35] Track-based video compression
    Carlotto, M. J.
    Ackenhusen, J. G.
    Suresh, B. R.
    DEFENSE TRANSFORMATION AND NET-CENTRIC SYSTEMS 2008, 2008, 6981
  • [36] Cellular Neural Network-based object-oriented video compression: Performance evaluation
    Grassi, Giuseppe
    Vecchio, Pietro
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2007, 14 (05): : 705 - 716
  • [37] Metaheuristic-based vector quantization approach: a new paradigm for neural network-based video compression
    Darwish, Saad M.
    Almajtomi, Ahmed A. J.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (05) : 7367 - 7396
  • [38] Metaheuristic-based vector quantization approach: a new paradigm for neural network-based video compression
    Saad M. Darwish
    Ahmed A. J. Almajtomi
    Multimedia Tools and Applications, 2021, 80 : 7367 - 7396
  • [39] Object based Hybrid Video Compression
    Gbadeyan, Rhoda
    Joslin, Chris
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 785 - 792
  • [40] Hyper-parameter optimization in neural-based translation systems: A case study
    Datta, Goutam
    Joshi, Nisheeth
    Gupta, Kusum
    INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2023, 16 (01):