Sensor Data Compression Using Bounded Error Piecewise Linear Approximation with Resolution Reduction

被引:11
作者
Lin, Jeng-Wei [1 ]
Liao, Shih-wei [2 ]
Leu, Fang-Yie [3 ]
机构
[1] Tunghai Univ, Dept Informat Management, Taichung 40704, Taiwan
[2] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 10617, Taiwan
[3] Tunghai Univ, Dept Comp Sci, Taichung 40704, Taiwan
关键词
Internet of Things; big data; data compression; bounded-error approximation; piecewise linear; resolution reduction; DATA FUSION; ALGORITHM; ENERGY; AGGREGATION;
D O I
10.3390/en12132523
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Smart production as one of the key issues for the world to advance toward Industry 4.0 has been a research focus in recent years. In a smart factory, hundreds or even thousands of sensors and smart devices are often deployed to enhance product quality. Generally, sensor data provides abundant information for artificial intelligence (AI) engines to make decisions for these smart devices to collect more data or activate some required activities. However, this also consumes a lot of energy to transmit the sensor data via networks and store them in data centers. Data compression is a common approach to reduce the sensor data size so as to lower transmission energies. Literature indicates that many Bounded-Error Piecewise Linear Approximation (BEPLA) methods have been proposed to achieve this. Given an error bound, they make efforts on how to approximate to the original sensor data with fewer line segments. In this paper, we furthermore consider resolution reduction, which sets a new restriction on the position of line segment endpoints. Swing-RR (Resolution Reduction) is then proposed. It has O(1) complexity in both space and time per data record. In other words, Swing-RR is suitable for compressing sensor data, particularly when the volume of the data is huge. Our experimental results on real world datasets show that the size of compressed data is significantly reduced. The energy consumed follows. When using minimal resolution, Swing-RR has achieved the best compression ratios for all tested datasets. Consequently, fewer bits are transmitted through networks and less disk space is required to store the data in data centers, thus consuming less data transmission and storage power.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] An Error Estimate of the Proper Orthogonal Decomposition in Model Reduction and Data Compression
    Wang, A-xia
    Ma, Yi-Chen
    NUMERICAL METHODS FOR PARTIAL DIFFERENTIAL EQUATIONS, 2009, 25 (04) : 972 - 989
  • [22] Two component data representation using piecewise approximation and specific points for IoT
    Park, Hyunjae
    Choi, Young-June
    2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2018, : 1191 - 1193
  • [23] Compression-based Data Reduction Technique for IoT Sensor Networks
    Abdulzahra, Suha Abdulhussein
    Al-Qurabat, Ali Kadhum M.
    Idrees, Ali Kadhum
    BAGHDAD SCIENCE JOURNAL, 2021, 18 (01) : 184 - 198
  • [24] FAZ: A flexible auto-tuned modular error-bounded compression framework for scientific data
    Liu, Jinyang
    Di, Sheng
    Zhao, Kai
    Liang, Xin
    Chen, Zizhong
    Cappello, Franck
    PROCEEDINGS OF THE 37TH INTERNATIONAL CONFERENCE ON SUPERCOMPUTING, ACM ICS 2023, 2023, : 1 - 13
  • [25] Increasing network lifetime using data compression in wireless sensor networks with energy harvesting
    Kim, Sunyong
    Cho, Chiwoo
    Park, Kyung-Joon
    Lim, Hyuk
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2017, 13 (01):
  • [26] Data Compression in Wireless Visual Sensor Networks using Wavelets
    Sofi, Shabir Ahmad
    Naaz, Roohie
    PROCEEDINGS OF THE 2016 IEEE INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, SIGNAL PROCESSING AND NETWORKING (WISPNET), 2016, : 1286 - 1290
  • [27] Reducing Soft-error Vulnerability of Caches using Data Compression
    Mittal, Sparsh
    Vetter, Jeffrey S.
    2016 INTERNATIONAL GREAT LAKES SYMPOSIUM ON VLSI (GLSVLSI), 2016, : 197 - 202
  • [28] Spline approximation-based data compression for sensor arrays in the wireless hydrologic monitoring system
    Li, Danyang
    Wei Huangfu
    Long, Keping
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2017, 13 (02):
  • [29] Compression of Cross-Section Data Size for High-Resolution Core Analysis Using Dimensionality Reduction Technique
    Yamamoto, Masato
    Endo, Tomohiro
    Yamamoto, Akio
    NUCLEAR SCIENCE AND ENGINEERING, 2021, 195 (01) : 33 - 49
  • [30] An approach to data redundancy reduction and secured data delivery using spatial-temporal correlation factors in heterogeneous Mobile Wireless Sensor Network
    Thandapani, Preethiya
    Arunachalam, Muthukumar
    Sundarraj, Durairaj
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2022, 35 (17)