HDQGF:Heterogeneous Data Quality Guarantee Framework Based on Deep Learning

被引:0
作者
Zhang, Yun [1 ,2 ]
Jin, Zongze [1 ]
Zhu, Weilin [1 ]
Chi, Lei [1 ,2 ]
Wang, Weiping [1 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD) | 2021年
关键词
date quality; data preprecessing; deep learning; heterogeneous integration;
D O I
10.1109/CSCWD49262.2021.9437684
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Although user-generated data on the Internet contains rich information, many approaches cannot effectively guarantee data quality for data analysis from raw data. In recent years, many researches on data quality guarantee using machine learning have shown that enhancing data quality is conducive to improve the accuracy of analysis results. But the existing approaches only consider the single dimension and neglect the fusion of heterogeneous data, such as images or social graphs. To consider this element and address the above issue, we leverage the deep learning technique to guarantee the data quality by using the heterogeneous data. Our framework is named HDQGF, which is an end-to-end approach using a combination of multiple networks to fuse heterogeneous information. In order to verify the effectiveness of the model, we designed related experiments on three real datasets. According to the experimental results, our model HDQGF can enhance the performance by improving the data quality.
引用
收藏
页码:901 / 906
页数:6
相关论文
共 50 条
  • [1] DeepFusion: A Deep Learning Framework for the Fusion of Heterogeneous Sensory Data
    Xue, Hongfei
    Jiang, Wenjun
    Miao, Chenglin
    Yuan, Ye
    Ma, Fenglong
    Ma, Xin
    Wang, Yijiang
    Yao, Shuochao
    Xu, Wenyao
    Zhang, Aidong
    Su, Lu
    PROCEEDINGS OF THE 2019 THE TWENTIETH ACM INTERNATIONAL SYMPOSIUM ON MOBILE AD HOC NETWORKING AND COMPUTING (MOBIHOC '19), 2019, : 151 - 160
  • [2] A Deep Learning-Based Framework for Offensive Text Detection in Unstructured Data for Heterogeneous Social Media
    Bacha, Jamshid
    Ullah, Farman
    Khan, Jebran
    Sardar, Abdul Wasay
    Lee, Sungchang
    IEEE ACCESS, 2023, 11 : 124484 - 124498
  • [3] A deep learning framework for Hybrid Heterogeneous Transfer Learning
    Zhou, Joey Tianyi
    Pan, Sinno Jialin
    Tsang, Ivor W.
    ARTIFICIAL INTELLIGENCE, 2019, 275 : 310 - 328
  • [4] DLPF: A parallel deep learning programming framework based on heterogeneous architecture
    Wang Y.
    Dou Y.
    Lü Q.
    Li B.
    Li T.
    1600, Science Press (53): : 1202 - 1210
  • [5] A unified deep learning framework for urban functional zone extraction based on multi-source heterogeneous data
    Lu, Weipeng
    Tao, Chao
    Li, Haifeng
    Qi, Ji
    Li, Yansheng
    REMOTE SENSING OF ENVIRONMENT, 2022, 270
  • [6] ImageDC: Image Data Cleaning Framework Based on Deep Learning
    Zhang, Yun
    Jin, Zongze
    Liu, Fan
    Zhu, Weilin
    Mu, Weimin
    Wang, Weiping
    PROCEEDINGS OF 2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS), 2020, : 748 - 752
  • [7] Deep learning for heterogeneous medical data analysis
    Lin Yue
    Dongyuan Tian
    Weitong Chen
    Xuming Han
    Minghao Yin
    World Wide Web, 2020, 23 : 2715 - 2737
  • [8] An intelligent cocoa quality testing framework based on deep learning techniques
    Essah R.
    Anand D.
    Singh S.
    Measurement: Sensors, 2022, 24
  • [9] Deep learning for heterogeneous medical data analysis
    Yue, Lin
    Tian, Dongyuan
    Chen, Weitong
    Han, Xuming
    Yin, Minghao
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2020, 23 (05): : 2715 - 2737
  • [10] Data-Worth Analysis for Heterogeneous Subsurface Structure Identification With a Stochastic Deep Learning Framework
    Zhan, Chuanjun
    Dai, Zhenxue
    Soltanian, Mohamad Reza
    de Barros, Felipe P. J.
    WATER RESOURCES RESEARCH, 2022, 58 (11)