An algorithm for information projection to an affine subspace

被引:0
|
作者
D. V. Vinogradov
机构
[1] Russian Academy of Sciences,Institute of Informatics Problems
[2] Russian State University for the Humanities,undefined
关键词
KL-distance; positive orthant; affine subspace; exponential family; maximum likelihood estimates;
D O I
10.3103/S0005105516030109
中图分类号
学科分类号
摘要
We investigate an algorithm to find a point of an affine subspace in the positive orthant such that it is the closest one to the original point with respect to the Kullback–Leibler distance. This problem is solved by means of the classical Darroch–Ratcliff algorithm (see [1]), while we use ideas of the information geometry founded by Chentsov (see [2]) and Csiszar (see [3]). The main theorem of the present work proves the convergence of that algorithm (the method of the proof is different from previous ones). The proposed algorithm can be applied, e.g., to find the maximum likelihood estimates in an exponential family (see the last section of the paper).
引用
收藏
页码:133 / 138
页数:5
相关论文
共 50 条
  • [21] An affine projection algorithm with variable step size and projection order
    Gonzalez, Alberto
    Ferrer, Miguel
    de Diego, Maria
    Pinero, Gema
    DIGITAL SIGNAL PROCESSING, 2012, 22 (04) : 586 - 592
  • [22] An affine projection algorithm with pseudo-fractional projection order
    Yoo J.
    Transactions of the Korean Institute of Electrical Engineers, 2019, 68 (07): : 904 - 907
  • [23] An Efficient MUSIC Algorithm Using Subspace Projection
    Ma, Yadong
    Cai, Jingjing
    Bao, Dan
    Feng, Xiaoping
    2015 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING (ICSPCC), 2015, : 930 - 935
  • [24] A one sided algorithm for subspace projection beamforming
    Smith, MJ
    Proudler, IK
    ADVANCED SIGNAL PROCESSING ALGORITHMS, ARCHITECTURES, AND IMPLEMENTATIONS VI, 1996, 2846 : 100 - 111
  • [25] An affine subspace clustering algorithm based on ridge regression
    Xu, Ya-jun
    Wu, Xiao-jun
    PATTERN ANALYSIS AND APPLICATIONS, 2017, 20 (02) : 557 - 566
  • [26] An affine subspace clustering algorithm based on ridge regression
    Ya-jun Xu
    Xiao-jun Wu
    Pattern Analysis and Applications, 2017, 20 : 557 - 566
  • [27] Combined Regularization Parameter Affine Projection Algorithm
    Jiang, Menghua
    Ou, Shifeng
    Gao, Ying
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 1486 - 1490
  • [28] Diffusion Affine Projection Algorithm for Multitask Networks
    Gogineni, Vinay Chakravarthi
    Chakraborty, Mrityunjoy
    2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 201 - 206
  • [29] An efficient implementation of the kernel affine projection algorithm
    Albu, Felix
    Coltuc, Dinu
    Rotaru, Marius
    Nishikawa, Kiyoshi
    2013 8TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA), 2013, : 349 - +
  • [30] REGULARIZATION OF THE IMPROVED PROPORTIONATE AFFINE PROJECTION ALGORITHM
    Paleologu, Constantin
    Benesty, Jacob
    Albu, Felix
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 169 - 172