Oscillation of Metropolis-Hastings and simulated annealing algorithms around LASSO estimator

被引:3
|
作者
Dermoune, Azzouz [1 ]
Ounaissi, Daoud [1 ]
Rahmania, Nadji [1 ]
机构
[1] USTL UMR CNRS 8524, Lab Paul Painleve, UFR Math, Bat M2, F-59655 Villeneuve Dascq, France
关键词
Penalized least squares; LASSO; Metropolis Hasting algorithm; Simulated annealing algorithm; Gibbs measures; BAYESIAN COMPUTATION; CONVERGENCE;
D O I
10.1016/j.matcom.2015.09.003
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this work we study, as the temperature goes to zero, the oscillation of a family of Gibbs measures around LASSO estimator. We derive new criteria for estimating LASSO, choosing the proposal distribution and the temperature in Metropolis Hastings algorithm. Finally we apply these results to analyse the convergence of Metropolis Hastings and simulated annealing algorithms. (C) 2015 International Association for Mathematics and Computers in Simulation (IMACS). Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:39 / 50
页数:12
相关论文
共 38 条
  • [1] On a Metropolis-Hastings importance sampling estimator
    Rudolf, Daniel
    Sprungk, Bjoern
    ELECTRONIC JOURNAL OF STATISTICS, 2020, 14 (01): : 857 - 889
  • [2] On directional Metropolis-Hastings algorithms
    Eidsvik, J
    Tjelmeland, H
    STATISTICS AND COMPUTING, 2006, 16 (01) : 93 - 106
  • [3] Langevin Diffusions and Metropolis-Hastings Algorithms
    G. O. Roberts
    O. Stramer
    Methodology And Computing In Applied Probability, 2002, 4 (4) : 337 - 357
  • [4] Metropolis-Hastings algorithms with adaptive proposals
    Cai, Bo
    Meyer, Renate
    Perron, Francois
    STATISTICS AND COMPUTING, 2008, 18 (04) : 421 - 433
  • [5] On the geometric ergodicity of Metropolis-Hastings algorithms
    Atchade, Yves F.
    Perron, Francois
    STATISTICS, 2007, 41 (01) : 77 - 84
  • [6] Convergence rates of Metropolis-Hastings algorithms
    Brown, Austin
    Jones, Galin L.
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2024, 16 (05):
  • [7] Improved Metropolis-Hastings algorithms via landscape modification with applications to simulated annealing and the Curie-Weiss model
    Choi, Michael C. H.
    ADVANCES IN APPLIED PROBABILITY, 2024, 56 (02) : 587 - 620
  • [8] Optimal scaling for various Metropolis-Hastings algorithms
    Roberts, GO
    Rosenthal, JS
    STATISTICAL SCIENCE, 2001, 16 (04) : 351 - 367
  • [9] A general construction for parallelizing Metropolis-Hastings algorithms
    Calderhead, Ben
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (49) : 17408 - 17413
  • [10] ACCELERATING METROPOLIS-HASTINGS ALGORITHMS BY DELAYED ACCEPTANCE
    Banterle, Marco
    Grazian, Clara
    Lee, Anthony
    Robert, Christian P.
    FOUNDATIONS OF DATA SCIENCE, 2019, 1 (02): : 103 - 128