Parameter tuning using asynchronous parallel pattern search in sparse signal reconstruction

被引:0
作者
DeGuchy, Omar [1 ]
Marcia, Roummel F. [1 ]
机构
[1] Univ Calif Merced, 5200 N Lake Rd, Merced, CA 95343 USA
来源
WAVELETS AND SPARSITY XVIII | 2019年 / 11138卷
基金
美国国家科学基金会;
关键词
Sparsity; signal processing; cross validation; non-convex optimization; Poisson log-likelihood; asynchronous parallel pattern search;
D O I
10.1117/12.2530229
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Parameter tuning is an important but often overlooked step in signal recovery problems. For instance, the regularization parameter in compressed sensing dictates the sparsity of the approximate signal reconstruction. More recently, there has been evidence that non-convex l(p) quasi-norm minimization, where 0 < p < 1, leads to an improvement in reconstruction over existing models that use convex regularization. However, these methods rely on good estimates of the value of not only p (the choice of norm) but also on the value of the penalty regularization parameter. This paper describes a method for choosing suitable parameters.The method involves creating a score to determine the effectiveness of the choice of parameters by partially reconstructing the signal. We then efficiently search through different combinations of parameters using a pattern search approach that exploits parallelism and asynchronicity to find the pair with the optimal score. We demonstrate the efficiency and accuracy of the proposed method through numerical experiments.
引用
收藏
页数:7
相关论文
共 25 条
  • [1] Adhikari L, 2015, INT CONF ACOUST SPEE, P1483, DOI 10.1109/ICASSP.2015.7178217
  • [2] [Anonymous], 2003, Department of Computer Science and Information Engineering
  • [3] [Anonymous], 2009, Tech. Rep. SAND2009-6265
  • [4] [Anonymous], J ACM
  • [5] Bergstra J, 2012, J MACH LEARN RES, V13, P281
  • [6] Choosing multiple parameters for support vector machines
    Chapelle, O
    Vapnik, V
    Bousquet, O
    Mukherjee, S
    [J]. MACHINE LEARNING, 2002, 46 (1-3) : 131 - 159
  • [7] DIRECT SEARCH METHODS ON PARALLEL MACHINES
    Dennis, J. E., Jr.
    Torczon, Virginia
    [J]. SIAM JOURNAL ON OPTIMIZATION, 1991, 1 (04) : 448 - 474
  • [8] Duchi J, 2011, J MACH LEARN RES, V12, P2121
  • [9] Research on collaborative negotiation for e-commerce.
    Feng, YQ
    Lei, Y
    Li, Y
    Cao, RZ
    [J]. 2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS, 2003, : 2085 - 2088
  • [10] Algorithm 856: APPSPACK 4.0: Asynchronous parallel pattern search for derivative-free optimization
    Gray, Genetha A.
    Kolda, Tamara G.
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2006, 32 (03): : 485 - 507