The Negative BER Loss Function for Deep Learning Decoders

被引:2
作者
Dong, Rui [1 ]
Lu, Fang [1 ]
Dong, Yan [1 ]
Yan, Haotian [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China
关键词
Decoding; Training; Deep learning; Maximum likelihood decoding; Bit error rate; Neural networks; Belief propagation; Deep learning decoders; loss function; error correcting codes; training concentration degree;
D O I
10.1109/LCOMM.2022.3178959
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
After certain training epochs of the deep learning decoders, the binary cross entropy (BCE) loss function ignores the training of some unsuccessful decoded information bits, thereby degrading the training efficiency. In this letter, we propose the negative bit error rate (NBER) loss function to increase the training concentration degree on the unsuccessful decoded information bits by modifying the gradient on different information bits, so that the training efficiency and decoding performance can be improved. The simulation results show that NBER could achieve significant performance improvement over BCE both in the deep neural network decoders and the weighted belief propagation decoders.
引用
收藏
页码:1824 / 1828
页数:5
相关论文
共 6 条
[1]  
Gruber T, 2017, 2017 51ST ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS)
[2]  
Lian M, 2019, IEEE INT SYMP INFO, P161, DOI [10.1109/isit.2019.8849419, 10.1109/ISIT.2019.8849419]
[3]  
Nachmani E, 2017, Arxiv, DOI arXiv:1702.07560
[4]   Deep Learning Methods for Improved Decoding of Linear Codes [J].
Nachmani, Eliya ;
Marciano, Elad ;
Lugosch, Loren ;
Gross, Warren J. ;
Burshtein, David ;
Be'ery, Yair .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2018, 12 (01) :119-131
[5]  
Nachmani E, 2016, ANN ALLERTON CONF, P341, DOI 10.1109/ALLERTON.2016.7852251
[6]  
Seo J, 2018, INT CONF COMPUT NETW, P238, DOI 10.1109/ICCNC.2018.8390279