An algorithm for information projection to an affine subspace

被引:0
|
作者
D. V. Vinogradov
机构
[1] Russian Academy of Sciences,Institute of Informatics Problems
[2] Russian State University for the Humanities,undefined
关键词
KL-distance; positive orthant; affine subspace; exponential family; maximum likelihood estimates;
D O I
10.3103/S0005105516030109
中图分类号
学科分类号
摘要
We investigate an algorithm to find a point of an affine subspace in the positive orthant such that it is the closest one to the original point with respect to the Kullback–Leibler distance. This problem is solved by means of the classical Darroch–Ratcliff algorithm (see [1]), while we use ideas of the information geometry founded by Chentsov (see [2]) and Csiszar (see [3]). The main theorem of the present work proves the convergence of that algorithm (the method of the proof is different from previous ones). The proposed algorithm can be applied, e.g., to find the maximum likelihood estimates in an exponential family (see the last section of the paper).
引用
收藏
页码:133 / 138
页数:5
相关论文
共 50 条
  • [31] Analysis of Affine Projection Normalized Correlation Algorithm
    Koike, Shin'ichi
    2016 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS), 2016, : 147 - 152
  • [32] Improved clipped affine projection adaptive algorithm
    Bekrani, Mehdi
    Bibak, Ruhollah
    Lotfizad, Mojtaba
    IET SIGNAL PROCESSING, 2019, 13 (01) : 103 - 111
  • [33] Set-membership affine projection algorithm
    Werner, S
    Diniz, PSR
    IEEE SIGNAL PROCESSING LETTERS, 2001, 8 (08) : 231 - 235
  • [34] An Affine Projection Algorithm with Decomposition for Improved Performance
    Radhika, S.
    Arumugam, Sivabalan
    2014 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMPUTING RESEARCH (IEEE ICCIC), 2014, : 429 - 434
  • [35] A Simplified Statistical Analysis of the Affine Projection Algorithm
    Koike, Shin'ichi
    2015 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS), 2015, : 565 - 569
  • [36] Adaptive regularization matrix for affine projection algorithm
    Choi, Young-Seok
    Shin, Hyun-Chool
    Song, Woo-Jin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2007, 54 (12) : 1087 - 1091
  • [37] A Practical Solution for the Regularization of the Affine Projection Algorithm
    Paleologu, Constantin
    Benesty, Jacob
    Ciochina, Silviu
    2014 10TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS (COMM), 2014,
  • [38] A new block exact affine projection algorithm
    Albu, F
    Kwan, HK
    2005 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), VOLS 1-6, CONFERENCE PROCEEDINGS, 2005, : 4337 - 4340
  • [39] Decorrelation affine projection algorithm and its application
    Wen, Hao-Xiang
    Chen, Long-Dao
    Cai, Zhong-Fa
    Chen, L.-D. (clongdao@soho.com), 1600, Zhejiang University (48): : 136 - 140
  • [40] Affine Projection Algorithm with Coefficient Vector Reusing
    Cho, Hyeonwoo
    Jeon, Yong-ju
    Choi, Doo-chul
    Kim, Sang Woo
    ECTI-CON: 2009 6TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY, VOLS 1 AND 2, 2009, : 1114 - 1116