Sensor Data Compression Using Bounded Error Piecewise Linear Approximation with Resolution Reduction

被引:11
作者
Lin, Jeng-Wei [1 ]
Liao, Shih-wei [2 ]
Leu, Fang-Yie [3 ]
机构
[1] Tunghai Univ, Dept Informat Management, Taichung 40704, Taiwan
[2] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 10617, Taiwan
[3] Tunghai Univ, Dept Comp Sci, Taichung 40704, Taiwan
关键词
Internet of Things; big data; data compression; bounded-error approximation; piecewise linear; resolution reduction; DATA FUSION; ALGORITHM; ENERGY; AGGREGATION;
D O I
10.3390/en12132523
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Smart production as one of the key issues for the world to advance toward Industry 4.0 has been a research focus in recent years. In a smart factory, hundreds or even thousands of sensors and smart devices are often deployed to enhance product quality. Generally, sensor data provides abundant information for artificial intelligence (AI) engines to make decisions for these smart devices to collect more data or activate some required activities. However, this also consumes a lot of energy to transmit the sensor data via networks and store them in data centers. Data compression is a common approach to reduce the sensor data size so as to lower transmission energies. Literature indicates that many Bounded-Error Piecewise Linear Approximation (BEPLA) methods have been proposed to achieve this. Given an error bound, they make efforts on how to approximate to the original sensor data with fewer line segments. In this paper, we furthermore consider resolution reduction, which sets a new restriction on the position of line segment endpoints. Swing-RR (Resolution Reduction) is then proposed. It has O(1) complexity in both space and time per data record. In other words, Swing-RR is suitable for compressing sensor data, particularly when the volume of the data is huge. Our experimental results on real world datasets show that the size of compressed data is significantly reduced. The energy consumed follows. When using minimal resolution, Swing-RR has achieved the best compression ratios for all tested datasets. Consequently, fewer bits are transmitted through networks and less disk space is required to store the data in data centers, thus consuming less data transmission and storage power.
引用
收藏
页数:20
相关论文
共 50 条
[41]   Muscles data compression in body sensor network using the principal component analysis in wavelet domain [J].
Khoei, Elmira Yekani ;
Hassannejad, Reza ;
Tazehkand, Behzad Mozaffari .
BIOIMPACTS, 2015, 5 (01) :9-16
[42]   In-network Data Compression in Wireless Sensor Networks Using Distributed Block Truncation Coding [J].
Thomas, Sanu ;
Mathew, Thomaskutty .
2018 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRONICS, COMPUTERS AND COMMUNICATIONS (ICAECC), 2018,
[43]   A novel data compression method using improved JPEG-LS in wireless sensor networks [J].
Lin, Chih-Chung ;
Chuang, Chi-Cheng ;
Chiang, Chien-Wen ;
Chang, Ray-I .
12TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY: ICT FOR GREEN GROWTH AND SUSTAINABLE DEVELOPMENT, VOLS 1 AND 2, 2010, :346-351
[44]   Studies of High Spectral Resolution Atmospheric Sounding Data Compression and Noise Reduction Based on Principal Component Analysis Method [J].
Zhang Shuiping ;
Zhang Shuiping .
PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, :4693-+
[45]   Efficient seismic response data storage and transmission using ARX model-based sensor data compression algorithm [J].
Zhang, YF ;
Li, J .
EARTHQUAKE ENGINEERING & STRUCTURAL DYNAMICS, 2006, 35 (06) :781-788
[46]   Area reduction and improvements in speed and compression ratio for a Lempel-Ziv data compression circuit using a content addressable memory [J].
Satoh, A .
ELECTRONICS AND COMMUNICATIONS IN JAPAN PART II-ELECTRONICS, 1999, 82 (03) :1-10
[47]   Data Reduction Using Change Coding for Remote Applications of wireless Visual Sensor Networks [J].
Aurangzeb, Khursheed ;
Alhussein, Musaed ;
O'Nils, Mattias .
IEEE ACCESS, 2018, 6 :37738-37747
[48]   Power quality disturbances classification using rotation forest and multi-resolution fast S-transform with data compression in time domain [J].
Huang, Nantian ;
Wang, Da ;
Lin, Lin ;
Cai, Guowei ;
Huang, Guilin ;
Du, Jiping ;
Zheng, Jian .
IET GENERATION TRANSMISSION & DISTRIBUTION, 2019, 13 (22) :5091-5101
[49]   Sensor data fusion for responsive high resolution ultrasonic temperature measurement using piezoelectric transducers [J].
Hashmi, Anas ;
Kalashnikov, Alexander N. .
ULTRASONICS, 2019, 99
[50]   Compression of Wearable Body Sensor Network Data Using Improved Two-Threshold-Two-Divisor Data Chunking Algorithms [J].
Raju, Robinson ;
Moh, Melody ;
Moh, Teng-Sheng .
PROCEEDINGS 2018 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2018, :949-956