Transfer learning for sparse variable selection in high-dimensional regression from quadratic measurement

被引:0
作者
Shang, Qingxu [1 ]
Li, Jie [2 ]
Song, Yunquan [2 ]
机构
[1] China Univ Petr, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] China Univ Petr, Coll Sci, Qingdao 266580, Peoples R China
关键词
Transfer learning; Variable selection; l(1/2) regularization; Quadratic measurement; Compressed sensing; STATISTICAL VIEW; REGULARIZATION;
D O I
10.1016/j.knosys.2024.112151
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In signal processing, the functional relationship between the unknown parameters and response variables extends to the nonlinear forms. A representative model is the quadratic measurement regression. In highdimensional scenarios, model complexity poses challenges for estimation and variable selection. In this study, we propose a generic transfer learning algorithm and an automatic transferable source detection algorithm to identify helpful sources for the quadratic measurement regression model. The core idea of the general algorithm is based on pre -training and fine-tuning techniques. To our knowledge, this is the first study that introduces transfer learning into this model. Numerous simulation experiments demonstrated the effectiveness of the proposed transfer learning algorithm. In simulation experiments, the proposed transfer algorithm reduced the square -sum error of the results to approximately 1. On a real -world speech dataset, the proposed algorithm significantly improved the accuracy of the reconstructed signals. In the best -case scenario, the minimum mean square error was reduced to 1/4th of that without transfer. The code is available at https://github.com/Sarkovqx/Transfer-QMR.
引用
收藏
页数:14
相关论文
共 43 条
  • [1] Transfer learning based hybrid 2D-3D CNN for traffic sign recognition and semantic road detection applied in advanced driver assistance systems
    Bayoudh, Khaled
    Hamdaoui, Faycal
    Mtibaa, Abdellatif
    [J]. APPLIED INTELLIGENCE, 2021, 51 (01) : 124 - 142
  • [2] SPARSITY CONSTRAINED NONLINEAR OPTIMIZATION: OPTIMALITY CONDITIONS AND ALGORITHMS
    Beck, Amir
    Eldar, Yonina C.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (03) : 1480 - 1509
  • [3] Cao L., 2024, Appl. Intell., P1
  • [4] Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage
    Chambolle, A
    DeVore, RA
    Lee, NY
    Lucier, BJ
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (03) : 319 - 335
  • [5] Deep learning-based important weights-only transfer learning approach for COVID-19 CT-scan classification
    Choudhary, Tejalal
    Gujar, Shubham
    Goswami, Anurag
    Mishra, Vipul
    Badal, Tapas
    [J]. APPLIED INTELLIGENCE, 2023, 53 (06) : 7201 - 7215
  • [6] Dettmers T, 2023, Arxiv, DOI [arXiv:2305.14314, DOI 10.48550/ARXIV.2305.14314]
  • [7] Devlin J, 2019, Arxiv, DOI arXiv:1810.04805
  • [8] Compressed sensing
    Donoho, DL
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) : 1289 - 1306
  • [9] Eamaz A, 2023, Arxiv, DOI arXiv:2303.09594
  • [10] Least angle regression - Rejoinder
    Efron, B
    Hastie, T
    Johnstone, I
    Tibshirani, R
    [J]. ANNALS OF STATISTICS, 2004, 32 (02) : 494 - 499