Cocv: A compression algorithm for time-series data with continuous constant values in IoT-based monitoring systems

被引:2
作者
Lin, Shengsheng [1 ]
Lin, Weiwei [1 ,2 ]
Wu, Keyi [3 ]
Wang, Songbo [1 ]
Xu, Minxian [4 ]
Wang, James Z. [5 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] South China Normal Univ, Guangzhou 510631, Peoples R China
[4] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[5] Clemson Univ, Sch Comp, Clemson, SC USA
基金
中国国家自然科学基金;
关键词
Compression algorithm; Internet of things; Time-series data; Continuous constant values; Gas-leak monitoring systems;
D O I
10.1016/j.iot.2023.101049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sensor-generated time-series data now constitutes a significant and growing portion of the world's data due to the rapid proliferation of the Internet of Things (IoT). The transmission and storage of such voluminous data have emerged as enormous challenges. Data compression and reduction strategies have been instrumental in mitigating these challenges to some extent. However, they have exhibited limitations when applied to real-time IoT-based monitoring systems. This stems from their failure to adequately consider the stringent requirements of real-time data transmission and the continuous constant-value redundancy within periodic monitoring data. Consequently, we introduce a dedicated compression algorithm tailored specifically for time-series data within periodic IoT-based monitoring systems, namely Cocv. It takes advantage of the continuous constant-value repetition of the time-series data to compress data by discarding redundant data points. It can not only compress static batches of data but also dynamically compress data streams to improve system performance in real-time IoT-based monitoring systems. The offline Cocv outperforms traditional compressors on gas-leak monitoring data with a compression ratio of 98.5%, maintaining a decent speed for both compression and decompression. In an actual IoT-based gas-leak monitoring system, the online Cocv improves handling capacity by 255%, reading speed by 728%, reduces bandwidth consumption by 94%, and storage space consumption by 98% compared to the original scheme.
引用
收藏
页数:14
相关论文
共 46 条
[1]   Compression-based Data Reduction Technique for IoT Sensor Networks [J].
Abdulzahra, Suha Abdulhussein ;
Al-Qurabat, Ali Kadhum M. ;
Idrees, Ali Kadhum .
BAGHDAD SCIENCE JOURNAL, 2021, 18 (01) :184-198
[2]  
Al-Qurabat Ali Kadhum M., 2020, IOP Conference Series: Materials Science and Engineering, V928, DOI 10.1088/1757-899X/928/3/032055
[3]   Two-level energy-efficient data reduction strategies based on SAX-LZW and hierarchical clustering for minimizing the huge data conveyed on the internet of things networks [J].
Al-Qurabat, Ali Kadhum M. ;
Abdulzahra, Suha Abdulhussein ;
Idrees, Ali Kadhum .
JOURNAL OF SUPERCOMPUTING, 2022, 78 (16) :17844-17890
[4]   Data Traffic Management Based on Compression and MDL Techniques for Smart Agriculture in IoT [J].
Al-Qurabat, Ali Kadhum M. ;
Mohammed, Zahraa A. ;
Hussein, Zahraa Jabbar .
WIRELESS PERSONAL COMMUNICATIONS, 2021, 120 (03) :2227-2258
[5]   Two Tier Data Reduction Technique for Reducing Data Transmission in IoT Sensors [J].
Al-Qurabat, Ali Kadhum M. ;
Abou Jaoude, Chady ;
Idrees, Ali Kadhum .
2019 15TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2019, :168-173
[6]   A comprehensive review on Internet of Things application placement in Fog computing environment [J].
Apat, Hemant Kumar ;
Nayak, Rashmiranjan ;
Sahoo, Bibhudatta .
INTERNET OF THINGS, 2023, 23
[7]   Lossy Data Compression for IoT Sensors: A Review [J].
Arias Correa, Juan David ;
Roschildt Pinto, Alex Sandro ;
Montez, Carlos .
INTERNET OF THINGS, 2022, 19
[8]   Sprintz: Time series compression for the Internet of things [J].
Blalock, Davis ;
Madden, Samuel ;
Guttag, John .
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018, 2 (03)
[9]   Time Series Compression Survey [J].
Chiarot, Giacomo ;
Silvestri, Claudio .
ACM COMPUTING SURVEYS, 2023, 55 (10)
[10]   Adaptive Multivariate Data Compression in Smart Metering Internet of Things [J].
Chowdhury, Mayukh Roy ;
Tripathi, Sharda ;
De, Swades .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (02) :1287-1297