Learning from streaming data with unsupervised heterogeneous domain adaptation

被引:0
作者
Moradi, Mona [1 ]
Rahmanimanesh, Mohammad [1 ]
Shahzadi, Ali [1 ]
机构
[1] Semnan Univ, Fac Elect & Comp Engn, Semnan, Iran
关键词
Concept drift; Heterogeneous domain adaptation; Streaming data; Unsupervised learning; DRIFT DETECTION METHODS; CHANGE-POINT DETECTION; TIME-SERIES DATA; NEURAL-NETWORKS; ONLINE; ENSEMBLE; MACHINE; ALGORITHM; MODEL;
D O I
10.1007/s41060-023-00463-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many efforts on domain adaptation focus on stationary environments and assume that the target domain samples are available before the learning process. However, real-world applications frequently involve the availability of non-stationary data sequentially. This study develops an unsupervised heterogeneous domain adaptation approach to address non-stationary scenarios where data streams continually feed the learning model. This process employs a fuzzy-based model that has been trained on a different but related domain. Subsequently, a neighborhood-based weight assignment fine-tunes the attraction and repulsion between neighbors based on prior knowledge about their domains and the similarity between class labels. To avoid unnecessary adaptation for each target domain chunk, domain adaptation is triggered only when concept drift is detected. This way, the model gradually adjusts to the evolving data, incorporating the unique characteristics of the new domain. When no drift is detected, existing parameters are reused for feature adaptation. At the end, the source domain is updated by incorporating the drifting data and their predicted labels. The proposed method offers several advantages, including avoidance of excessive alignment, reduction in domain adaptation cost, and a gradual reduction in dependency on the source domain for domain adaptation. To evaluate the method's performance, experiments were conducted on several tasks extracted from two benchmark datasets, considering different types of concept drift. The experimental results demonstrate that the proposed model significantly improves classification accuracy while reducing computational time.
引用
收藏
页码:61 / 81
页数:21
相关论文
共 89 条
  • [61] Knowledge-maximized ensemble algorithm for different types of concept drift
    Ren, Siqi
    Liao, Bo
    Zhu, Wen
    Li, Keqin
    [J]. INFORMATION SCIENCES, 2018, 430 : 261 - 281
  • [62] Exponentially weighted moving average charts for detecting concept drift
    Ross, Gordon J.
    Adams, Niall M.
    Tasoulis, Dimitris K.
    Hand, David J.
    [J]. PATTERN RECOGNITION LETTERS, 2012, 33 (02) : 191 - 198
  • [63] Ruiz Sanchez E., 2021, LEARNING RULES DATA
  • [64] Supervised and Semi-Supervised Multi-View Canonical Correlation Analysis Ensemble for Heterogeneous Domain Adaptation in Remote Sensing Image Classification
    Samat, Alim
    Persello, Claudio
    Gamba, Paolo
    Liu, Sicong
    Abuduwaili, Jilili
    Li, Erzhu
    [J]. REMOTE SENSING, 2017, 9 (04)
  • [65] On the reliable detection of concept drift from streaming unlabeled data
    Sethi, Tegjyot Singh
    Kantardzic, Mehmed
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2017, 82 : 77 - 99
  • [66] Sheskin David J., 2003, Handbook of Parametric and Nonparametric Statistical Procedures
  • [67] Domain adaptation with geometrical preservation and distribution alignment
    Sun, Jing
    Wang, Zhihui
    Wang, Wei
    Li, Haojie
    Sun, Fuming
    [J]. NEUROCOMPUTING, 2021, 454 : 152 - 167
  • [68] A new predictive method supporting streaming data with hybrid recurring concept drifts in process industry
    Sun, Linjin
    Ji, Yangjian
    Zhu, Mingrui
    Gu, Fu
    Dai, Feng
    Li, Ke
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 161
  • [69] Source-Free Unsupervised Domain Adaptation with Sample Transport Learning
    Tian, Qing
    Ma, Chuang
    Zhang, Feng-Yuan
    Peng, Shun
    Xue, Hui
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2021, 36 (03) : 606 - 616
  • [70] Visual Domain Adaptation with Manifold Embedded Distribution Alignment
    Wang, Jindong
    Feng, Wenjie
    Chen, Yiqiang
    Yu, Han
    Huang, Meiyu
    Yu, Philip S.
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 402 - 410