FAST QTMT PARTITION FOR VVC INTRA CODING USING U-NET FRAMEWORK

被引:3
|
作者
Zan, Zhao [1 ]
Huang, Leilei [2 ]
Chen, ShuShi [1 ]
Zhang, Xiantao [3 ]
Zhao, Zhenghui [3 ]
Yin, Haibing [4 ]
Fan, Yibo [1 ]
机构
[1] Fudan Univ, Shanghai, Peoples R China
[2] East China Normal Univ, Shanghai, Peoples R China
[3] Alibaba Grp, Hangzhou, Peoples R China
[4] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
基金
中国国家自然科学基金;
关键词
VVC; intra coding; U-Net; complexity; DECISION; NETWORK;
D O I
10.1109/ICIP49359.2023.10221979
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Versatile Video Coding (VVC) has significantly increased encoding efficiency at the expense of numerous complex coding tools, particularly the flexible Quad-Tree plus Multi-type Tree (QTMT) block partition. This paper proposes a deep learning-based algorithm applied in fast QTMT partition for VVC intra coding. Our solution greatly reduces encoding time by early termination of less-likely intra prediction and partitions with negligible BD-BR increase. Firstly, a redesigned U-Net is recommended as the network's fundamental framework. Next, we design a Quality Parameter (QP) fusion network to regulate the effect of QPs on the partition results. Finally, we adopt a refined post-processing strategy to better balance encoding performance and complexity. Experimental results demonstrate that our solution outperforms the state-of-the-art works with a complexity reduction of 44.74% to 68.76% and a BD-BR increase of 0.60% to 2.33%.
引用
收藏
页码:600 / 604
页数:5
相关论文
共 50 条
  • [31] Multiple classifier-based fast coding unit partition for intra coding in future video coding
    Peng, Zongju
    Huang, Chao
    Chen, Fen
    Jiang, Gangyi
    Cui, Xin
    Yu, Mei
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 78 : 171 - 179
  • [32] Speech Enhancement Using U-Net with Compressed Sensing
    Kang, Zheng
    Huang, Zhihua
    Lu, Chenhua
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [33] A fast H.266/QTMT intra coding scheme based on predictions of learned models
    Chen, Jiann-Jone
    Huang, Yu-Huan
    Yu, Han-Yen
    Tsai, Yao-Hong
    JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS, 2024, 47 (06) : 703 - 718
  • [34] Fast CU Partition and Intra Mode Decision Method for H.266/VVC
    Zhang, Qiuwen
    Wang, Yihan
    Huang, Lixun
    Jiang, Bin
    IEEE ACCESS, 2020, 8 : 117539 - 117550
  • [35] Robust U-Net: Development of robust image enhancement model using modified U-Net architecture
    Bhavani, Murapaka Dhanalakshmi
    Murugan, Raman
    Goel, Tripti
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (28)
  • [36] Clothing Parsing using Extended U-Net
    Vozarikova, Gabriela
    Stana, Richard
    Semanisin, Gabriel
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 15 - 24
  • [37] IDENTIFYING SETTLEMENTS USING SVM AND U-NET
    Mutreja, Guneet
    Kumar, Sandeep
    Jha, Divyansh
    Singh, Abhra
    Singh, Rohit
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1217 - 1220
  • [38] An Efficient Tongue Segmentation Model Based on U-Net Framework
    Ruan, Qunsheng
    Wu, Qingfeng
    Yao, Junfeng
    Wang, Yingdong
    Tseng, Hsien-Wei
    Zhang, Zhiling
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (16)
  • [39] Drought Stress Segmentation on Drone captured Maize using Ensemble U-Net framework
    Tejasri, N.
    Sai, Ujwal G.
    Rajalakshmi, P.
    Naik, Balaji
    Desai, Uday B.
    2022 IEEE 5TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING APPLICATIONS AND SYSTEMS, IPAS, 2022,
  • [40] Semantic segmentation of human cell nucleus using deep U-Net and other versions of U-Net models
    Yadavendra
    Chand, Satish
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2022, 33 (3-4) : 167 - 186