LEARNED LAYERED CODING FOR SUCCESSIVE REFINEMENT IN THE WYNER-ZIV PROBLEM

被引:2
作者
Joukovsky, Boris [1 ,2 ]
De Weerdt, Brent [1 ,2 ]
Deligiannis, Nikos [1 ,2 ]
机构
[1] Vrije Univ Brussel VUB, IETRO Dept, Pleinlaan 2, B-1050 Brussels, Belgium
[2] Imec, Kapeldreef 75, B-3001 Leuven, Belgium
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024 | 2024年
关键词
Wyner-Ziv coding; successive refinement; layered coding; nested scalar quantization; recurrent neural networks; SIDE INFORMATION;
D O I
10.1109/ICASSP48485.2024.10446574
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
We propose a data-driven approach to explicitly learn the progressive encoding of a continuous source, which is successively decoded with increasing levels of quality and with the aid of correlated side information. This setup refers to the successive refinement of the Wyner-Ziv coding problem. Assuming ideal Slepian-Wolf coding, our approach employs recurrent neural networks (RNNs) to learn layered encoders and decoders for the quadratic Gaussian case. The models are trained by minimizing a variational bound on the rate-distortion function of the successively refined Wyner-Ziv coding problem. We demonstrate that RNNs can explicitly retrieve layered binning solutions akin to scalable nested quantization. Moreover, the rate-distortion performance of the scheme is on par with the corresponding monolithic Wyner-Ziv coding approach and is close to the ratedistortion bound.
引用
收藏
页码:6020 / 6024
页数:5
相关论文
共 24 条
[1]   Learned Gradient Compression for Distributed Deep Learning [J].
Abrahamyan, Lusine ;
Chen, Yiming ;
Bekoulis, Giannis ;
Deligiannis, Nikos .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (12) :7330-7344
[2]  
Balle J., 2016, ARXIV161101704
[3]   Successive wyner-ziv coding scheme and its application to the quadratic Gaussian CEO problem [J].
Chen, Jun ;
Berger, Toby .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2008, 54 (04) :1586-1603
[4]   Successive refinement for the Wyner-Ziv problem and layered code design [J].
Cheng, S ;
Xiong, ZX .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2005, 53 (08) :3269-3281
[5]   The No-Rate-Loss Property of Wyner-Ziv Coding in the Z-Channel Correlation Case [J].
Deligiannis, Nikos ;
Sechelea, Andrei ;
Munteanu, Adrian ;
Cheng, Samuel .
IEEE COMMUNICATIONS LETTERS, 2014, 18 (10) :1675-1678
[6]   Maximum Likelihood Laplacian Correlation Channel Estimation in Layered Wyner-Ziv Coding [J].
Deligiannis, Nikos ;
Munteanu, Adrian ;
Wang, Shuang ;
Cheng, Samuel ;
Schelkens, Peter .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (04) :892-904
[7]  
Jang E., 2017, CATEGORICAL REPARAME
[8]  
Lei Eric, 2023, 2023 IEEE International Symposium on Information Theory (ISIT), P525, DOI 10.1109/ISIT54713.2023.10206457
[9]  
Maddison C.J., 2017, CONCRETE DISTRIBUTIO
[10]   Neural Distributed Image Compression with Cross-Attention Feature Alignment [J].
Mital, Nitish ;
Ozyilkan, Ezgi ;
Garjani, Ali ;
Gunduz, Deniz .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :2497-2506