Neural-Based Video Compression on Solar Dynamics Observatory Images

被引:0
|
作者
Khoshkhahtinat, Atefeh [1 ]
Zafari, Ali [1 ]
Mehta, Piyush M. [1 ]
Nasrabadi, Nasser M. [1 ]
Thompson, Barbara J. [2 ]
Kirk, Michael S. F. [2 ]
da Silva, Daniel E. [2 ]
机构
[1] West Virginia Univ, Morgantown, WV 26506 USA
[2] NASA Goddard Space Flight Ctr, Greenbelt, MD 20771 USA
基金
美国国家航空航天局;
关键词
Entropy; Image coding; Decoding; Video compression; Adaptation models; Transform coding; Context modeling; Entropy model; neural video compression; Solar Dynamics Observatory (SDO); transformer;
D O I
10.1109/TAES.2024.3409524
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
NASA's Solar Dynamics Observatory (SDO) mission collects extensive data to monitor the Sun's daily activity. In the realm of space mission design, data compression plays a crucial role in addressing the challenges posed by limited telemetry rates. The primary objective of data compression is to facilitate efficient data management and transmission to work within the constrained bandwidth, thereby ensuring that essential information is captured while optimizing the utilization of available resources. This article introduces a neural video compression technique that achieves a high compression ratio for the SDO's image data collection. The proposed approach focuses on leveraging both temporal and spatial redundancies in the data, leading to a more efficient compression. In this work, we introduce an architecture based on the transformer model, which is specifically designed to capture both local and global information from input images in an effective and efficient manner. In addition, our network is equipped with an entropy model that can accurately model the probability distribution of the latent representations and improves the speed of the entropy decoding step. The entropy model leverages a channel-dependent approach and utilizes checkerboard-shaped local and global spatial contexts. By combining the transformer-based video compression network with our entropy model, the proposed compression algorithm demonstrates superior performance over traditional video codecs like H.264 and H.265, as confirmed by our experimental results.
引用
收藏
页码:6685 / 6701
页数:17
相关论文
共 50 条
  • [41] Neural Video Compression Using GANs for Detail Synthesis and Propagation
    Mentzer, Fabian
    Agustsson, Eirikur
    Balle, Johannes
    Minnen, David
    Johnston, Nick
    Toderici, George
    COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 562 - 578
  • [42] Advanced 3D Motion Prediction for Video-Based Dynamic Point Cloud Compression
    Li, Li
    Li, Zhu
    Zakharchenko, Vladyslav
    Chen, Jianle
    Li, Houqiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 289 - 302
  • [43] Segmentation based compression for graylevel images
    Biswas, S
    PATTERN RECOGNITION, 2003, 36 (07) : 1501 - 1517
  • [44] VCNPU: An Algorithm-Hardware Co-Optimized Framework for Accelerating Neural Video Compression
    Zhang, Siyu
    Mao, Wendong
    Wang, Zhongfeng
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2024,
  • [45] An Effectual Video Compression Scheme for WVSNs Based on Block Compressive Sensing
    Priya, G. L.
    Ghosh, Debashis
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (02): : 1542 - 1552
  • [46] HDVC: Deep Video Compression With Hyperprior-Based Entropy Coding
    Hu, Yusong
    Jung, Cheolkon
    Qin, Qipu
    Han, Jiang
    Liu, Yang
    Li, Ming
    IEEE ACCESS, 2024, 12 : 17541 - 17551
  • [47] High-Definition Video Compression System Based on Perception Guidance of Salient Information of a Convolutional Neural Network and HEVC Compression Domain
    Zhu, Shiping
    Liu, Chang
    Xu, Ziyao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (07) : 1946 - 1959
  • [48] A Curated Image Parameter Data Set from the Solar Dynamics Observatory Mission
    Ahmadzadeh, Azim
    Kempton, Dustin J.
    Angryk, Rafal A.
    ASTROPHYSICAL JOURNAL SUPPLEMENT SERIES, 2019, 243 (01)
  • [49] Object Detection-Based Video Compression
    Kim, Myung-Jun
    Lee, Yung-Lyul
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [50] Content-Based image and video compression
    Du, X
    Li, HL
    Ahalt, SC
    ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY IX, 2002, 4727 : 299 - 309