Deep Learning Methods for Improved Decoding of Linear Codes

被引:410
作者
Nachmani, Eliya [1 ]
Marciano, Elad [1 ]
Lugosch, Loren [2 ]
Gross, Warren J. [2 ]
Burshtein, David [1 ]
Be'ery, Yair [1 ]
机构
[1] Tel Aviv Univ, Sch Elect Engn, IL-6997801 Tel Aviv, Israel
[2] McGill Univ, Dept Elect & Comp Engn, Montreal, PQ H3A 0G4, Canada
基金
以色列科学基金会;
关键词
Deep learning; error correcting codes; belief propagation; min-sum decoding; NEURAL-NETWORKS;
D O I
10.1109/JSTSP.2017.2788405
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The problem of low complexity, close to optimal, channel decoding of linear codes with short to moderate block length is considered. It is shown that deep learning methods can be used to improve a standard belief propagation decoder, despite the large example space. Similar improvements are obtained for the min-sum algorithm. It is also shown that tying the parameters of the decoders across iterations, so as to form a recurrent neural network architecture, can be implemented with comparable results. The advantage is that significantly less parameters are required. We also introduce a recurrent neural decoder architecture based on the method of successive relaxation. Improvements over standard belief propagation are also observed on sparser Tanner graph representations of the codes. Furthermore, we demonstrate that the neural belief propagation decoder can be used to improve the performance, or alternatively reduce the computational complexity, of a close to optimal decoder of short BCH codes.
引用
收藏
页码:119 / 131
页数:13
相关论文
共 41 条
[1]  
Abadi M., 2015, PREPRINT
[2]  
[Anonymous], P INT C MACH LEARN
[3]  
[Anonymous], 1963, Low-Density Parity-Check Codes
[4]  
[Anonymous], 2017, CORR
[5]  
Cammerer S., 2017, CORR
[6]   Improved Random Redundant Iterative HDPC Decoding [J].
Dimnik, Ilan ;
Be'ery, Yair .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2009, 57 (07) :1982-1985
[7]   SOFT-DECISION DECODING OF LINEAR BLOCK-CODES BASED ON ORDERED STATISTICS [J].
FOSSORIER, MPC ;
LIN, S .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (05) :1379-1396
[8]   Iterative reliability-based decoding of low-density parity check codes [J].
Fossorier, MPC .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2001, 19 (05) :908-917
[9]  
Goldin D, 2017, IEEE INT SYMP INFO, P2603, DOI 10.1109/ISIT.2017.8007000
[10]  
Graves A, 2013, INT CONF ACOUST SPEE, P6645, DOI 10.1109/ICASSP.2013.6638947