Deep Learning for Channel Coding via Neural Mutual Information Estimation

被引:12
作者
Fritschek, Rick [1 ]
Schaefer, Rafael F. [2 ]
Wunder, Gerhard [1 ]
机构
[1] Free Univ Berlin, Heisenberg Commun & Informat Theory Grp, Takustr 9, D-14195 Berlin, Germany
[2] Tech Univ Berlin, Informat Theory & Applicat Chair, Einsteinufer 25, D-10587 Berlin, Germany
来源
2019 IEEE 20TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC 2019) | 2019年
关键词
D O I
10.1109/spawc.2019.8815464
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
End-to-end deep learning for communication systems, i.e., systems whose encoder and decoder are learned, has attracted significant interest recently, due to its performance which comes close to well-developed classical encoder-decoder designs. However, one of the drawbacks of current learning approaches is that a differentiable channel model is needed for the training of the underlying neural networks. In real-world scenarios, such a channel model is hardly available and often the channel density is not even known at all. Some works, therefore, focus on a generative approach, i.e., generating the channel from samples, or rely on reinforcement learning to circumvent this problem. We present a novel approach which utilizes a recently proposed neural estimator of mutual information. We use this estimator to optimize the encoder for a maximized mutual information, only relying on channel samples. Moreover, we show that our approach achieves the same performance as state-of-the-art end-to-end learning with perfect channel model knowledge.
引用
收藏
页数:5
相关论文
共 20 条
[1]  
[Anonymous], 2018, ARXIV180303145
[2]  
[Anonymous], 2018, IEEE J-STSP, DOI DOI 10.1109/JSTSP.2017.2784180
[3]  
[Anonymous], 2018, ARXIV181005419
[4]  
[Anonymous], 2012, PROC 29 INT C MACH L
[5]  
[Anonymous], 2015, TENSORFLOW LARGE SCA
[6]  
[Anonymous], 2018, P 2018 IEEE GLOB WOR
[7]  
[Anonymous], 2018, P 35 INT C MACH LEAR
[8]  
[Anonymous], 2018, ARXIV180402276
[9]  
Barber David, 2003, ADV NEURAL INFORM PR
[10]   Estimation of the information by an adaptive partitioning of the observation space [J].
Darbellay, GA ;
Vajda, I .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1999, 45 (04) :1315-1321