Hyperparameter Tuning to Optimize Implementations of Denoising Autoencoders for Imputation of Missing Spatio-temporal Data

被引:4
|
作者
Siddiqi, Muhammad Danial [1 ]
Jiang, Boyuan [1 ,2 ]
Asadi, Reza [1 ]
Regan, Amelia [1 ,2 ]
机构
[1] Univ Calif Irvine, Donald Bren Sch Informat & Comp Sci ICS, Irvine, CA 92697 USA
[2] Univ Calif Irvine, Inst Transportat Studies ITS, Irvine, CA 92697 USA
关键词
Transportation data analysis; Spatio-temporal problem; Denoising autoencoder; Missing data imputation;
D O I
10.1016/j.procs.2021.04.001
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Spatio-temporal data collected from sensors can sometimes have gaps where data is missing. Transportation planners and engineers use such data to perform various different types of analyses, but the gaps in the data make it difficult to make accurate predictions. Denoising Autoencoders are used to generate a cleaner version of the input signals This includes generating data for missing or dropped input signals as well. We used three different deep learning models to implement Denoising Autoencoders to measure each model's accuracy. Since tuning the hyperparameters can influence the accuracy of the predictions of a model, each model was optimized by focusing on four main parameters. Each of the hyperparameters had a different effect on each of the models. The simplest of the models yielded much better results than anticipated after optimizing The most complex of the models was still better, but only slightly. That slight improvement required one hundred times the computational cost required by the simplest model. Tuning the hyperparameters to optimize a simpler model can prove more beneficial than creating a more complex model that is slower and difficult to optimize (C) 2021 The Authors. Published by Elsevier B.V.
引用
收藏
页码:107 / 114
页数:8
相关论文
共 50 条
  • [1] MIDIA: exploring denoising autoencoders for missing data imputation
    Qian Ma
    Wang-Chien Lee
    Tao-Yang Fu
    Yu Gu
    Ge Yu
    Data Mining and Knowledge Discovery, 2020, 34 : 1859 - 1897
  • [2] MIDIA: exploring denoising autoencoders for missing data imputation
    Ma, Qian
    Lee, Wang-Chien
    Fu, Tao-Yang
    Gu, Yu
    Yu, Ge
    DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (06) : 1859 - 1897
  • [3] Missing value imputation in food composition data with denoising autoencoders
    Gjorshoska, Ivana
    Eftimov, Tome
    Trajanov, Dimitar
    JOURNAL OF FOOD COMPOSITION AND ANALYSIS, 2022, 112
  • [4] Imputation of Missing Traffic Flow Data Using Denoising Autoencoders
    Jiang, Boyuan
    Siddiqi, Muhammad Danial
    Asadi, Reza
    Regan, Amelia
    12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 84 - 91
  • [5] Missing Data Imputation via Denoising Autoencoders: The Untold Story
    Costa, Adriana Fonseca
    Santos, Miriam Seoane
    Soares, Jastin Pompeu
    Abreu, Pedro Henriques
    ADVANCES IN INTELLIGENT DATA ANALYSIS XVII, IDA 2018, 2018, 11191 : 87 - 98
  • [6] Missing data imputation for traffic flow speed using spatio-temporal cokriging
    Bae, Bumjoon
    Kim, Hyun
    Lim, Hyeonsup
    Liu, Yuandong
    Han, Lee D.
    Freeze, Phillip B.
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2018, 88 : 124 - 139
  • [7] Sequential Imputation of Missing Spatio-Temporal Precipitation Data Using Random Forests
    Mital, Utkarsh
    Dwivedi, Dipankar
    Brown, James B.
    Faybishenko, Boris
    Painter, Scott L.
    Steefel, Carl I.
    FRONTIERS IN WATER, 2020, 2
  • [9] Missing data imputation in tunnel monitoring with a spatio-temporal correlation fused machine learning model
    Tan, Xuyan
    Chen, Weizhong
    Tan, Xianjun
    Fan, Chengkai
    Mao, Yuhao
    Cheng, Ke
    Du, Bowen
    JOURNAL OF CIVIL STRUCTURAL HEALTH MONITORING, 2024,
  • [10] An Enhanced Imputation Approach for Spatio-Temporal Clinical Data
    Yin, Yilin
    Chou, Chun-An
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2022, : 813 - 818