Lossless compression method for ultraspectral sounder data based on key information extraction and spectral-spatial prediction

被引:0
作者
Chen, Hao [1 ]
Chen, Jinyi [1 ]
Gao, Mengmeng [1 ]
Lu, Junhong [1 ]
机构
[1] Harbin Inst Technol, Dept Informat Engn, Harbin, Peoples R China
基金
中国国家自然科学基金;
关键词
lossless compression; ultraspectral sounder data; key information extraction; spectral-spatial prediction; VECTOR QUANTIZATION; LINEAR PREDICTION; INFRARED SOUNDER; ALGORITHM; RECOVERY; PACKING;
D O I
10.1117/1.JRS.15.036513
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Given the unprecedented size of ultraspectral sounder data, there is a special process of radiance thinning in assimilating this data to reduce the data volume with minimal loss of atmospheric information. Considering the potential correlation between the selected data by radiance thinning and the unselected data, a lossless compression method for ultraspectral sounder data is proposed based on key information extraction and spatial-spectral prediction. Sensitive channels are first selected by stepwise iteration based on information entropy to maintain critical atmospheric information, and then auxiliary channels are further selected based on information content and correlation constraints to facilitate prediction. All of the selected channels are spatially thinned to generate key information, which is then used to predict original ultaspectral sounder data by spatially bicubic interpolation and spectrally sparse reconstruction. The residual errors are processed by the least-squares linear prediction to further reduce data redundancy. Together with the key information, the final residual errors are then fed into a range coder after positive mapping and histogram packing. Experimental results with IASI-L1C data show that the proposed method achieves an average compression ratio of 2.68, which is 4.7% higher than that of the typical methods, including JPEG-LS, JPEG-2000, M-CALIC, CCSDS-122.0, CCDS-123.0, and HEVC. (C) 2021 Society of Photo-Optical Instrumentation Engineers (SPIE)
引用
收藏
页数:20
相关论文
共 46 条
  • [41] A maritime traffic route extraction method based on density-based spatial clustering of applications with noise for multi-dimensional data
    Huang, Changhai
    Qi, Xucun
    Zheng, Jian
    Zhu, Ranchao
    Shen, Jia
    OCEAN ENGINEERING, 2023, 268
  • [42] A Supervised Filter Feature Selection method for mixed data based on Spectral Feature Selection and Information-theory redundancy analysis
    Solorio-Fernandez, Saul
    Fco Martinez-Trinidad, Jose
    Ariel Carrasco-Ochoa, J.
    PATTERN RECOGNITION LETTERS, 2020, 138 : 321 - 328
  • [43] Key technologies for ultra-high throughput neural signal recording: A graphical data compression method based on two-dimensional compressed sensing
    Fan, Guangsen
    Yin, Ming
    Wang, Yonghuan
    Yu, Shanshan
    Wang, X.
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 104
  • [44] Key point extraction method for spatial objects in high-resolution remote sensing images based on multi-hot cross-entropy loss
    Chen, Jun
    Yu, Zhengyang
    Yang, Cunjian
    OPEN GEOSCIENCES, 2022, 14 (01): : 1409 - 1420
  • [45] A novel semi-supervised soft sensor modeling method based on deep dynamic and semantic information extraction for concentrate grade prediction in froth flotation
    Zheng, Boyi
    Xu, Degang
    Tan, Guanzheng
    Chen, Yiwei
    Cai, Yaoyi
    MINERALS ENGINEERING, 2023, 201
  • [46] A deep learning-based method for deep information extraction from multimodal data for geological reports to support geological knowledge graph construction
    Chen, Yan
    Tian, Miao
    Wu, Qirui
    Tao, Liufeng
    Jiang, Tingyao
    Qiu, Qinjun
    Huang, Hua
    EARTH SCIENCE INFORMATICS, 2024, 17 (03) : 1867 - 1887