Lossless compression method for ultraspectral sounder data based on key information extraction and spectral-spatial prediction

被引:0
作者
Chen, Hao [1 ]
Chen, Jinyi [1 ]
Gao, Mengmeng [1 ]
Lu, Junhong [1 ]
机构
[1] Harbin Inst Technol, Dept Informat Engn, Harbin, Peoples R China
基金
中国国家自然科学基金;
关键词
lossless compression; ultraspectral sounder data; key information extraction; spectral-spatial prediction; VECTOR QUANTIZATION; LINEAR PREDICTION; INFRARED SOUNDER; ALGORITHM; RECOVERY; PACKING;
D O I
10.1117/1.JRS.15.036513
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Given the unprecedented size of ultraspectral sounder data, there is a special process of radiance thinning in assimilating this data to reduce the data volume with minimal loss of atmospheric information. Considering the potential correlation between the selected data by radiance thinning and the unselected data, a lossless compression method for ultraspectral sounder data is proposed based on key information extraction and spatial-spectral prediction. Sensitive channels are first selected by stepwise iteration based on information entropy to maintain critical atmospheric information, and then auxiliary channels are further selected based on information content and correlation constraints to facilitate prediction. All of the selected channels are spatially thinned to generate key information, which is then used to predict original ultaspectral sounder data by spatially bicubic interpolation and spectrally sparse reconstruction. The residual errors are processed by the least-squares linear prediction to further reduce data redundancy. Together with the key information, the final residual errors are then fed into a range coder after positive mapping and histogram packing. Experimental results with IASI-L1C data show that the proposed method achieves an average compression ratio of 2.68, which is 4.7% higher than that of the typical methods, including JPEG-LS, JPEG-2000, M-CALIC, CCSDS-122.0, CCDS-123.0, and HEVC. (C) 2021 Society of Photo-Optical Instrumentation Engineers (SPIE)
引用
收藏
页数:20
相关论文
共 46 条
  • [21] Correlation-based band-ordering heuristic for lossless compression of hyperspectral sounder data
    Toivanen, P
    Kubasova, O
    Mielikainen, J
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2005, 2 (01) : 50 - 54
  • [22] Spectral-Spatial Classification of Hyperspectral Data Based on Deep Belief Network
    Chen, Yushi
    Zhao, Xing
    Jia, Xiuping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) : 2381 - 2392
  • [23] Weighted-Correlation based Band Reordering Heuristics for Lossless Compression of Remote Sensing Hyperspectral Sounder Data
    Ibn Afjal, Masud
    Al Mamun, Md.
    Uddin, Md. Palash.
    2018 INTERNATIONAL CONFERENCE ON ADVANCEMENT IN ELECTRICAL AND ELECTRONIC ENGINEERING (ICAEEE), 2018,
  • [24] Near-lossless and lossy compression of imaging spectrometer data: comparison of information extraction performance
    Miguel, Agnieszka
    Riskin, Eve
    Ladner, Richard
    Barney, Dane
    SIGNAL IMAGE AND VIDEO PROCESSING, 2012, 6 (04) : 597 - 611
  • [25] An effective feature extraction method via spectral-spatial filter discrimination analysis for hyperspectral image
    Li, Li
    Gao, Jianqiang
    Ge, Hongwei
    Zhang, Yixin
    Zhang, Haifei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (28) : 40871 - 40904
  • [26] Wavelet-Based Spectral-Spatial Transforms for CFA-Sampled Raw Camera Image Compression
    Suzuki, Taizo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 433 - 444
  • [27] A module-based LSB substitution method with lossless secret data compression
    Chen, Shang-Kuan
    COMPUTER STANDARDS & INTERFACES, 2011, 33 (04) : 367 - 371
  • [28] Lossless compression of three-dimensional hyperspectral sounder data using context-based adaptive lossless image codec with bias-adjusted reordering
    Huang, BM
    Ahuja, A
    Huang, HL
    Schmit, TJ
    Heymann, RW
    OPTICAL ENGINEERING, 2004, 43 (09) : 2071 - 2079
  • [29] Reformulating Key-Information Extraction as Next Sentence Prediction for Hierarchical Data
    Kubade, Ashish
    Akundi, Prathyusha
    Mohd, Bilal Arif Syed
    DOCUMENT ANALYSIS AND RECOGNITION-ICDAR 2024 WORKSHOPS, PT II, 2024, 14936 : 175 - 183
  • [30] An Adaptive Prediction-Based Approach to Lossless Compression of Floating-Point Volume Data
    Fout, Nathaniel
    Ma, Kwan-Liu
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2012, 18 (12) : 2295 - 2304