Equivalence of ML decoding to a continuous optimization problem

被引:0
作者
Srinivasavaradhan, Sundara Rajan [1 ]
Diggavi, Suhas [1 ]
Fragouli, Christina [1 ]
机构
[1] Univ Calif Los Angeles, Los Angeles, CA 90095 USA
来源
2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT) | 2020年
基金
美国国家科学基金会;
关键词
Maximum-Likelihood; Symbolwise MAP; Deletion Channels; Expected Likelihood; COMPLEXITY; CODES;
D O I
10.1109/isit44484.2020.9174130
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Maximum likelihood (ML) and symbolwise maximum aposteriori (MAP) estimation for discrete input sequences play a central role in a number of applications that arise in communications, information and coding theory. Many instances of these problems are proven to be intractable, for example through reduction to NP-complete integer optimization problems. In this work, we prove that the ML estimation of a discrete input sequence (with no assumptions on the encoder/channel used) is equivalent to the solution of a continuous non-convex optimization problem, and that this formulation is closely related to the computation of symbolwise MAP estimates. This equivalence is particularly useful in situations where a function we term the expected likelihood is efficiently computable. In such situations, we give a ML heuristic and show numerics for sequence estimation over the deletion channel.
引用
收藏
页码:343 / 348
页数:6
相关论文
共 21 条
[1]   OPTIMAL DECODING OF LINEAR CODES FOR MINIMIZING SYMBOL ERROR RATE [J].
BAHL, LR ;
COCKE, J ;
JELINEK, F ;
RAVIV, J .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1974, 20 (02) :284-287
[2]  
BATU T., 2004, P 15 ANN ACM SIAM S, P910
[3]  
Berlekamp REFERENCES E., 2006, IEEE T INF THEOR, V24, P384
[4]   RELATIVE ENTROPY RELAXATIONS FOR SIGNOMIAL OPTIMIZATION [J].
Chandrasekaran, Venkat ;
Shah, Parikshit .
SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) :1147-1173
[5]   Sharp Analytical Capacity Upper Bounds for Sticky and Related Channels [J].
Cheraghchi, Mahdi ;
Ribeiro, Joao .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (11) :6950-6974
[6]   Optimal Mean-Based Algorithms for Trace Reconstruction [J].
De, Anindya ;
O'Donnell, Ryan ;
Servedio, Rocco A. .
STOC'17: PROCEEDINGS OF THE 49TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING, 2017, :1047-1056
[7]   DECODING BY LOCAL OPTIMIZATION [J].
FARRELL, KH ;
RUDOLPH, LD ;
HARTMANN, CRP ;
NIELSEN, LD .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1983, 29 (05) :740-743
[8]  
FINCKE U, 1985, MATH COMPUT, V44, P463, DOI 10.1090/S0025-5718-1985-0777278-8
[9]   VITERBI ALGORITHM [J].
FORNEY, GD .
PROCEEDINGS OF THE IEEE, 1973, 61 (03) :268-278
[10]   LOW-DENSITY PARITY-CHECK CODES [J].
GALLAGER, RG .
IRE TRANSACTIONS ON INFORMATION THEORY, 1962, 8 (01) :21-&