Combining Spatial and Temporal Properties for Improvements in Data Reduction

被引:1
|
作者
Fulp, Megan Hickman [1 ]
Biswas, Ayan [2 ]
Calhoun, Jon C. [1 ]
机构
[1] Clemson Univ, Holcombe Dept Elect & Comp Engn, Clemson, SC 29634 USA
[2] Los Alamos Natl Lab, Los Alamos, NM USA
基金
美国国家科学基金会;
关键词
Data Reduction; Data Sampling; Importance Sampling; Feature Preservation; LOSSY COMPRESSION; TIME; VISUALIZATION;
D O I
10.1109/BigData50022.2020.9378457
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to I/O bandwidth limitations, intelligent in situ data reduction methods are needed to enable post-hoc workflows. Current state-of-the-art sampling methods save data points if they deem them spatially or temporally important. By analyzing the properties of the data values at each time-step, two consecutive steps may be very similar. This research follows the notion that if neighboring time-steps are very similar, samples from both are unnecessary, which leaves storage for adding more useful samples. Here, we present an investigation of the combination of spatial and temporal sampling to drastically reduce data size without the loss of valuable information. We demonstrate that, by reusing samples, our reconstructed data set reduces the overall data size while achieving a higher post-reconstruction quality over other reduction methods.
引用
收藏
页码:2654 / 2663
页数:10
相关论文
共 50 条
  • [1] Accelerated dynamic data reduction using spatial and temporal properties
    Fulp, Megan Hickman
    Fulp, Dakota
    Zou, Changfeng
    Sanders, Cooper
    Biswas, Ayan
    Smith, Melissa C.
    Calhoun, Jon C.
    INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2023, 37 (05): : 539 - 559
  • [2] Classification of gait patterns combining their spatial and temporal properties
    He, Q
    Debrunner, C
    Carollo, JJ
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 1894 - 1898
  • [3] Reliable spatial and temporal data redundancy reduction approach for WSN
    Yemeni, Zaid
    Wang, Haibin
    Ismael, Waleed M.
    Wang, Yanan
    Chen, Zhengming
    Computer Networks, 2021, 185
  • [4] Reliable spatial and temporal data redundancy reduction approach for WSN
    Yemeni, Zaid
    Wang, Haibin
    Ismael, Waleed M.
    Wang, Yanan
    Chen, Zhengming
    COMPUTER NETWORKS, 2021, 185
  • [5] Combining random forest and graph wavenet for spatial-temporal data prediction
    Chen C.
    Xu Y.
    Zhao J.
    Chen L.
    Xue Y.
    Intelligent and Converged Networks, 2022, 3 (04): : 364 - 377
  • [6] Combining measures for temporal and spatial locality
    Duemmler, Joerg
    Rauber, Thomas
    Ruenger, Gudula
    FRONTIERS OF HIGH PERFORMANCE COMPUTING AND NETWORKING - ISPA 2006 WORKSHOPS, PROCEEDINGS, 2006, 4331 : 697 - +
  • [7] Combining incompatible spatial data
    Gotway, CA
    Young, LJ
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2002, 97 (458) : 632 - 648
  • [8] Combining AVHRR-NDVI and landuse data to describe temporal and spatial dynamics of vegetation
    Senay, GB
    Elliott, RL
    FOREST ECOLOGY AND MANAGEMENT, 2000, 128 (1-2) : 83 - 91
  • [9] The effect of spatial resolution reduction techniques on the temporal properties of video sequences
    Saitwal, K
    Maciejewski, AA
    Roberts, RG
    2005 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2005, : 4049 - 4054
  • [10] Spatial and temporal prediction of soil properties from legacy data
    Marchant, B. P.
    Crawford, D. M.
    Robinson, N. J.
    DIGITAL SOIL ASSESSMENTS AND BEYOND, 2012, : 239 - 244