Imputing Missing Data in One-Shot Devices Using Unsupervised Learning Approach

被引:0
|
作者
So, Hon Yiu [1 ]
Ling, Man Ho [2 ]
Balakrishnan, Narayanaswamy [3 ]
机构
[1] Oakland Univ, Dept Math & Stat, Rochester, MI 48309 USA
[2] Educ Univ Hong Kong, Dept Math & Informat Technol, Hong Kong, Peoples R China
[3] McMaster Univ, Dept Math & Stat, Hamilton, ON L8S 4K1, Canada
关键词
one-shot devices; missing data; clustering; imputation; inverse probability weighting; unsupervised learning; k-prototype; DBSCAN; MULTIPLE IMPUTATION; CHAINED EQUATIONS; ALGORITHM; INFERENCE;
D O I
10.3390/math12182884
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
One-shot devices are products that can only be used once. Typical one-shot devices include airbags, fire extinguishers, inflatable life vests, ammo, and handheld flares. Most of them are life-saving products and should be highly reliable in an emergency. Quality control of those productions and predicting their reliabilities over time is critically important. To assess the reliability of the products, manufacturers usually test them in controlled conditions rather than user conditions. We may rely on public datasets that reflect their reliability in actual use, but the datasets often come with missing observations. The experimenter may lose information on covariate readings due to human errors. Traditional missing-data-handling methods may not work well in handling one-shot device data as they only contain their survival statuses. In this research, we propose Multiple Imputation with Unsupervised Learning (MIUL) to impute the missing data using Hierarchical Clustering, k-prototype, and density-based spatial clustering of applications with noise (DBSCAN). Our simulation study shows that MIUL algorithms have superior performance. We also illustrate the method using datasets from the Crash Report Sampling System (CRSS) of the National Highway Traffic Safety Administration (NHTSA).
引用
收藏
页数:33
相关论文
共 50 条
  • [1] A reinforcement learning-based approach for imputing missing data
    Awan, Saqib Ejaz
    Bennamoun, Mohammed
    Sohel, Ferdous
    Sanfilippo, Frank
    Dwivedi, Girish
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (12) : 9701 - 9716
  • [2] A reinforcement learning-based approach for imputing missing data
    Saqib Ejaz Awan
    Mohammed Bennamoun
    Ferdous Sohel
    Frank Sanfilippo
    Girish Dwivedi
    Neural Computing and Applications, 2022, 34 : 9701 - 9716
  • [3] Flexible High-Dimensional Unsupervised Learning with Missing Data
    Wei, Yuhong
    Tang, Yang
    McNicholas, Paul D.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (03) : 610 - 621
  • [4] Imputing environmental impact missing data of the industrial sector for Chinese cities: A machine learning approach
    Chen, Xi
    Shuai, Chenyang
    Zhao, Bu
    Zhang, Yu
    Li, Kaijian
    ENVIRONMENTAL IMPACT ASSESSMENT REVIEW, 2023, 100
  • [5] A Reinforcement One-Shot Active Learning Approach for Aircraft Type Recognition
    Huang, Honglan
    Feng, Yanghe
    Huang, Jincai
    Zhang, Jiarui
    Chen, Li
    IEEE ACCESS, 2019, 7 : 147204 - 147214
  • [6] Using neural networks for imputing missing values in insurance data
    Gan, Guojun
    Yan, Yueming
    JAPANESE JOURNAL OF STATISTICS AND DATA SCIENCE, 2025,
  • [7] Missing Data Imputation based on Unsupervised Simple Competitive Learning
    Lee, Byoung Jik
    PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, KNOWLEDGE ENGINEERING AND DATA BASES, 2010, : 292 - +
  • [8] Unsupervised learning of Dirichlet process mixture models with missing data
    Zhang, Xunan
    Song, Shiji
    Zhu, Lei
    You, Keyou
    Wu, Cheng
    SCIENCE CHINA-INFORMATION SCIENCES, 2016, 59 (01) : 1 - 14
  • [9] One-Shot Ontogenetic Learning in Biomedical Datastreams
    Kalantari, John
    Mackey, Michael A.
    ARTIFICIAL GENERAL INTELLIGENCE: 10TH INTERNATIONAL CONFERENCE, AGI 2017, 2017, 10414 : 143 - 153
  • [10] Collaborating filtering using unsupervised learning for image reconstruction from missing data
    Banouar, Oumayma
    Mohaoui, Souad
    Raghay, Said
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2018,