HDQGF:Heterogeneous Data Quality Guarantee Framework Based on Deep Learning

被引:0
作者
Zhang, Yun [1 ,2 ]
Jin, Zongze [1 ]
Zhu, Weilin [1 ]
Chi, Lei [1 ,2 ]
Wang, Weiping [1 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD) | 2021年
关键词
date quality; data preprecessing; deep learning; heterogeneous integration;
D O I
10.1109/CSCWD49262.2021.9437684
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Although user-generated data on the Internet contains rich information, many approaches cannot effectively guarantee data quality for data analysis from raw data. In recent years, many researches on data quality guarantee using machine learning have shown that enhancing data quality is conducive to improve the accuracy of analysis results. But the existing approaches only consider the single dimension and neglect the fusion of heterogeneous data, such as images or social graphs. To consider this element and address the above issue, we leverage the deep learning technique to guarantee the data quality by using the heterogeneous data. Our framework is named HDQGF, which is an end-to-end approach using a combination of multiple networks to fuse heterogeneous information. In order to verify the effectiveness of the model, we designed related experiments on three real datasets. According to the experimental results, our model HDQGF can enhance the performance by improving the data quality.
引用
收藏
页码:901 / 906
页数:6
相关论文
共 50 条
  • [21] A deep learning-based CEP rule extraction framework for IoT data
    Mehmet Ulvi Simsek
    Feyza Yildirim Okay
    Suat Ozdemir
    The Journal of Supercomputing, 2021, 77 : 8563 - 8592
  • [22] A Deep Learning Based Framework for Malaria Diagnosis on High Variation Data Set
    Zedda, Luca
    Loddo, Andrea
    Di Ruberto, Cecilia
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT II, 2022, 13232 : 358 - 370
  • [23] ErgoReport: A Holistic Posture Assessment Framework Based on Inertial Data and Deep Learning
    Martins, Diogo R.
    Cerqueira, Sara M.
    Pombeiro, Ana
    da Silva, Alexandre Ferreira
    Rocha, Ana Maria A. C.
    Santos, Cristina P.
    SENSORS, 2025, 25 (07)
  • [24] Deep Learning-based Evolutionary Recommendation Model for Heterogeneous Big Data Integration
    Yoo, Hyun
    Chung, Kyungyong
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (09) : 3730 - 3744
  • [25] Deep learning-based roadway crack classification with heterogeneous image data fusion
    Zhou, Shanglian
    Song, Wei
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2021, 20 (03): : 1274 - 1293
  • [26] Recommended Model for Fusing Multi-Source Heterogeneous Data Based on Deep Learning
    Ji Z.-Y.
    Song X.-J.
    Pi H.-Y.
    Yang C.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2019, 42 (06): : 35 - 42
  • [27] Deep-Edge: An Efficient Framework for Deep Learning Model Update on Heterogeneous Edge
    Bhattacharjee, Anirban
    Chhokra, Ajay Dev
    Sun, Hongyang
    Shekhar, Shashank
    Gokhale, Aniruddha
    Karsai, Gabor
    Dubey, Abhishek
    4TH IEEE INTERNATIONAL CONFERENCE ON FOG AND EDGE COMPUTING (ICFEC 2020), 2020, : 75 - 84
  • [28] Deep Air Quality Forecasting Using Hybrid Deep Learning Framework
    Du, Shengdong
    Li, Tianrui
    Yang, Yan
    Horng, Shi-Jinn
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (06) : 2412 - 2424
  • [29] DeepSIG: A Hybrid Heterogeneous Deep Learning Framework for Radio Signal Classification
    Qiu, Kunfeng
    Zheng, Shilian
    Zhang, Luxin
    Lou, Caiyi
    Yang, Xiaoniu
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (01) : 775 - 788
  • [30] Deep Reinforcement Learning Framework for Joint Resource Allocation in Heterogeneous Networks
    Zhang, Yong
    Kang, Canping
    Teng, YingLei
    Li, Sisi
    Zheng, WeiJun
    Fang, JingHui
    2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL), 2019,