Cocv: A compression algorithm for time-series data with continuous constant values in IoT-based monitoring systems

被引:2
作者
Lin, Shengsheng [1 ]
Lin, Weiwei [1 ,2 ]
Wu, Keyi [3 ]
Wang, Songbo [1 ]
Xu, Minxian [4 ]
Wang, James Z. [5 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] South China Normal Univ, Guangzhou 510631, Peoples R China
[4] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[5] Clemson Univ, Sch Comp, Clemson, SC USA
基金
中国国家自然科学基金;
关键词
Compression algorithm; Internet of things; Time-series data; Continuous constant values; Gas-leak monitoring systems;
D O I
10.1016/j.iot.2023.101049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sensor-generated time-series data now constitutes a significant and growing portion of the world's data due to the rapid proliferation of the Internet of Things (IoT). The transmission and storage of such voluminous data have emerged as enormous challenges. Data compression and reduction strategies have been instrumental in mitigating these challenges to some extent. However, they have exhibited limitations when applied to real-time IoT-based monitoring systems. This stems from their failure to adequately consider the stringent requirements of real-time data transmission and the continuous constant-value redundancy within periodic monitoring data. Consequently, we introduce a dedicated compression algorithm tailored specifically for time-series data within periodic IoT-based monitoring systems, namely Cocv. It takes advantage of the continuous constant-value repetition of the time-series data to compress data by discarding redundant data points. It can not only compress static batches of data but also dynamically compress data streams to improve system performance in real-time IoT-based monitoring systems. The offline Cocv outperforms traditional compressors on gas-leak monitoring data with a compression ratio of 98.5%, maintaining a decent speed for both compression and decompression. In an actual IoT-based gas-leak monitoring system, the online Cocv improves handling capacity by 255%, reading speed by 728%, reduces bandwidth consumption by 94%, and storage space consumption by 98% compared to the original scheme.
引用
收藏
页数:14
相关论文
共 20 条
  • [1] IFRAT: An IoT Field Recognition Algorithm based on Time-series Data
    Guo, Shuai
    Guo, Zhongwen
    Qiu, Zhijin
    Liu, Yingjian
    Wang, Yu
    2017 3RD INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM), 2017, : 251 - 255
  • [2] A novel clustering algorithm for time-series data based on precise correlation coefficient matching in the IoT
    Li, Haibo
    Tong, Juncheng
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2019, 16 (06) : 6654 - 6671
  • [3] Real-Time AI and IoT-Based Systems for Home Monitoring
    Alex, Adoumadji Benoudjita
    Hanyurwimfura, Damien
    Bakunzibake, Pierre
    PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, VOL 10, ICICT 2024, 2025, 1055 : 415 - 426
  • [4] An Efficient Algorithm for Finding Continuous Coherent Evolution Bicluster in Time-series Data
    Xue, Yun
    Luo, Jie
    Zhang, Haolan
    Liao, Zhengling
    Li, Meihang
    Kuang, Qiuhua
    2014 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOP (ICDMW), 2014, : 906 - 912
  • [5] Data Quality in IoT-Based Air Quality Monitoring Systems: a Systematic Mapping Study
    Buelvas, Julio
    Munera, Danny
    Tobon, V. Diana P. P.
    Aguirre, Johnny
    Gaviria, Natalia
    WATER AIR AND SOIL POLLUTION, 2023, 234 (04)
  • [6] Data Quality in IoT-Based Air Quality Monitoring Systems: a Systematic Mapping Study
    Julio Buelvas
    Danny Múnera
    Diana P. Tobón V.
    Johnny Aguirre
    Natalia Gaviria
    Water, Air, & Soil Pollution, 2023, 234
  • [7] Lossless Data Compression for Time-Series Sensor Data Based on Dynamic Bit Packing
    Hwang, Sang-Ho
    Kim, Kyung-Min
    Kim, Sungho
    Kwak, Jong Wook
    SENSORS, 2023, 23 (20)
  • [8] Lossless Compression of Time-Series Data Based on Increasing Average of Neighboring Signals
    Takezawa, Tetsuya
    Asakura, Koichi
    Watanabe, Toyohide
    ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2010, 93 (08) : 47 - 56
  • [9] Advantages of IoT-Based Geotechnical Monitoring Systems Integrating Automatic Procedures for Data Acquisition and Elaboration
    Carri, Andrea
    Valletta, Alessandro
    Cavalca, Edoardo
    Savi, Roberto
    Segalini, Andrea
    SENSORS, 2021, 21 (06)
  • [10] A lossless compression method of time-series data based on increasing average of neighboring signals
    Takezawa, Tetsuya
    Asakura, Koichi
    Watanabe, Toyohide
    IEEJ Transactions on Electronics, Information and Systems, 2008, 128 (02) : 318 - 325+19