Active learning sample selection - based on multicriteria

被引:0
作者
He, Zhonghai [1 ,2 ]
Shen, Kun [1 ,4 ]
Zhang, Xiaofang [3 ]
机构
[1] Northeastern Univ Qinhuangdao, Sch Control Engn, Qinhuangdao, Peoples R China
[2] Hebei Key Lab Micronano Precis Opt Sensing & Meas, Qinhuangdao, Peoples R China
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing, Peoples R China
[4] Northeastern Univ Qinhuangdao, Sch Control Engn, Qinhuangdao 066000, Peoples R China
关键词
Multivariate calibration; multicriteria modeling; active learning; sample selection; CALIBRATION; REGRESSION; DENSITY; QUERY; SETS;
D O I
10.1177/09670335231211618
中图分类号
O69 [应用化学];
学科分类号
081704 ;
摘要
In multivariate calibration problems, model performance is affected significantly by the calibration samples used during model building. In recent years, active learning methods have become one of the best methods for sample selection. However, most active learning methods only select instances from prediction uncertainty or sample space distance, and these single-criteria methods tend to select undesired samples. In addition, sample density characterizes the spatial information carried by the sample, but few studies in quantitative analysis utilize sample density alone to select calibration samples. Considering these issues, based on the k-means clustering algorithm, this paper proposes an active learning sample selection method (DIDAL), which combines the three criteria of diversity, informativeness and sample density. The most representative sample is iteratively selected for - addition to the calibration set for modeling and estimating the chemical concentration of analytes. Soybean meal and soy sauce samples were analyzed by DIDAL and compared with existing sample selection methods. The prediction results show that the DIDAL algorithm significantly outperforms several existing algorithms and is close to the performance of full-sample modeling. A model with high prediction accuracy can be constructed by selecting only a few samples using the DIDAL method.
引用
收藏
页码:289 / 297
页数:9
相关论文
共 23 条
  • [1] Bujrbidge R, 2007, LECT NOTES COMPUT SC, V4881, P209
  • [2] Batch Mode Active Learning for Regression With Expected Model Change
    Cai, Wenbin
    Zhang, Muhan
    Zhang, Ya
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (07) : 1668 - 1681
  • [3] Active learning for ranking with sample density
    Cai, Wenbin
    Zhang, Muhan
    Zhang, Ya
    [J]. INFORMATION RETRIEVAL JOURNAL, 2015, 18 (02): : 123 - 144
  • [4] Maximizing Expected Model Change for Active Learning in Regression
    Cai, Wenbin
    Zhang, Ya
    Zhou, Jun
    [J]. 2013 IEEE 13TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2013, : 51 - 60
  • [5] A multiple criteria active learning method for support vector regression
    Demir, Beguem
    Bruzzone, Lorenzo
    [J]. PATTERN RECOGNITION, 2014, 47 (07) : 2558 - 2567
  • [6] Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images
    Demir, Begum
    Persello, Claudio
    Bruzzone, Lorenzo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (03): : 1014 - 1031
  • [7] Cost-efficient unsupervised sample selection for multivariate calibration
    Diaz, Valeria Fonseca
    De Ketelaere, Bart
    Aernouts, Ben
    Saeys, Wouter
    [J]. CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2021, 215
  • [8] Active learning for spectroscopic data regression
    Douak, Fouzi
    Melgani, Farid
    Alajlan, Naif
    Pasolli, Edoardo
    Bazi, Yakoub
    Benoudjit, Nabil
    [J]. JOURNAL OF CHEMOMETRICS, 2012, 26 (07) : 374 - 383
  • [9] A method for calibration and validation subset partitioning
    Galvao, RKH
    Araujo, MCU
    José, GE
    Pontes, MJC
    Silva, EC
    Saldanha, TCB
    [J]. TALANTA, 2005, 67 (04) : 736 - 740
  • [10] Combination of active learning and self-training for cross-lingual sentiment classification with density analysis of unlabelled samples
    Hajmohammadi, Mohammad Sadegh
    Ibrahim, Roliana
    Selamat, Ali
    Fujita, Hamido
    [J]. INFORMATION SCIENCES, 2015, 317 : 67 - 77