Fast Prediction Algorithm in High Efficiency Video Coding Intra-mode Based on Deep Feature Learning

被引:3
作者
Jia Kebin [1 ]
Cui Tenghe
Liu Pengyu
Liu Chang
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
High Efficiency Video Coding(HEVC); Complexity reduction; Deep learning; Intra coding;
D O I
10.11999/JEIT200414
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Compared to H.264/AVC coding standard, High Efficiency Video Coding (HEVC) improves the compression efficiency, but the consequent disadvantage is the significant increase in encoding complexity by using the quad-tree partition. A Multi-Layer Feature Transfer Convolutional Neural Network (MLFT-CNN) for Coding Unit (CU) division and characterization vector prediction in HEVC intra coding mode is proposed, which greatly reduces the complexity of video coding. Firstly, a reduced-resolution feature extraction module incorporating CU partition structure information is proposed. Then, the channel attention mechanism is improved for a better texture expression performance of the feature. After that, the feature transfer mechanism is designed to use the feature division of high-depth coding unit to guide the division of low-depth coding unit. Finally, the target loss function represented by the segmented feature is established, and the end-to-end CU division represents the vector prediction network. The experimental results show that the proposed algorithm effectively reduces the encoding complexity of HEVC without affecting the video coding quality. Specifically, compared to the standard method, the encoding complexity on the standard test sequence is reduced by 70.96% on average.
引用
收藏
页码:2023 / 2031
页数:9
相关论文
共 20 条
[1]  
[Anonymous], HM SOFTW
[2]  
BJONTEGARD G., 2001, 13 VID COD EXP GROUP
[3]   Fast CU partition-based machine learning approach for reducing HEVC complexity [J].
Bouaafia, Soulef ;
Khemiri, Randa ;
Sayadi, Fatma Ezahra ;
Atri, Mohamed .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (01) :185-196
[4]   Performance and Computational Complexity Assessment of High-Efficiency Video Encoders [J].
Correa, Guilherme ;
Assuncao, Pedro ;
Agostini, Luciano ;
da Silva Cruz, Luis A. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (12) :1899-1909
[5]   Fast Intra CTU Depth Decision for HEVC [J].
Feng, Zeqi ;
Liu, Pengyu ;
Jia, Kebin ;
Duan, Kun .
IEEE ACCESS, 2018, 6 :45262-45269
[6]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[7]   Block Partitioning Structure in the HEVC Standard [J].
Kim, Il-Koo ;
Min, Junghye ;
Lee, Tammy ;
Han, Woo-Jin ;
Park, JeongHoon .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (12) :1697-1706
[8]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[9]   Run-Time Deep Learning Enhanced Fast Coding Unit Decision for High Efficiency Video Coding [J].
Li, Xin ;
Gong, Na .
JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2020, 29 (03)
[10]   Fast CU Size Decisions for HEVC Intra Frame Coding Based on Support Vector Machines [J].
Liu, Deyuan ;
Liu, Xingang ;
Li, Yayong .
2016 IEEE 14TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 14TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 2ND INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/DATACOM/CYBERSC, 2016, :594-597