Conformer Based No-Reference Quality Assessment for UGC Video

被引:0
作者
Yang, Zike [1 ]
Zhang, Yingxue [1 ]
Si, Zhanjun [1 ]
机构
[1] Tianjin Univ Sci & Technol, Coll Artificial Intelligence, Tianjin 300457, Peoples R China
来源
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VI, ICIC 2024 | 2024年 / 14867卷
关键词
video quality assessment; Conformer; UGC video;
D O I
10.1007/978-981-97-5597-4_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the lack of reference videos and complex distortions, video quality assessment (VQA) for user-generated content (UGC) has become a highly challenging task. Previous studies have fully demonstrated the effectiveness of deep learning models in UGC VQA, but most methods only use a single CNN or Transformer to extract features, without fully integrating the advantages of them. In this paper, we propose a no-reference video quality assessment method based on Conformer, which utilizes convolutional neural networks and self-attention mechanisms in parallel to obtain features more suitable for UGC video quality. A Feature Attention (FA) module is further proposed to help the model focus on important parts of the video. The experimental results show that the proposed model achieves good performance on mainstream subjective UGC video quality databases, indicating the effectiveness on UGC VQA.
引用
收藏
页码:464 / 472
页数:9
相关论文
共 50 条
  • [21] No-Reference Video Quality Assessment Design Framework Based on Modular Neural Networks
    Kukolj, Dragan D.
    Pokric, Maja
    Zlokolica, Vladimir M.
    Filipovic, Jovana
    Temerinac, Miodrag
    [J]. ARTIFICIAL NEURAL NETWORKS-ICANN 2010, PT I, 2010, 6352 : 569 - 574
  • [22] No-reference hybrid video quality assessment based on partial least squares regression
    Wang, Zhengyou
    Wang, Wan
    Wan, Zheng
    Xia, Yanhui
    Lin, Weisi
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (23) : 10277 - 10290
  • [23] No-reference hybrid video quality assessment based on partial least squares regression
    Zhengyou Wang
    Wan Wang
    Zheng Wan
    Yanhui Xia
    Weisi Lin
    [J]. Multimedia Tools and Applications, 2015, 74 : 10277 - 10290
  • [24] Bitrate-Based No-Reference Video Quality Assessment Combining the Visual Perception of Video Contents
    Yao, Juncai
    Liu, Guizhong
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2019, 65 (03) : 546 - 557
  • [25] Spatiotemporal Feature Combination Model for No-Reference Video Quality Assessment
    Men, Hui
    Lin, Hanhe
    Saupe, Dietmar
    [J]. 2018 TENTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2018, : 72 - 74
  • [26] Hybrid No-Reference Video Quality Assessment Focusing on Codec Effects
    Liu, Xingang
    Chen, Min
    Wan, Tang
    Yu, Chen
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2011, 5 (03): : 592 - 606
  • [27] A No-reference Quality Assessment System for Video Streaming over RTP
    Yang, Fuzheng
    Song, Jiarun
    Wan, Shuai
    [J]. MATERIALS SCIENCE AND ENGINEERING, PTS 1-2, 2011, 179-180 : 243 - +
  • [28] StableVQA: A Deep No-Reference Quality Assessment Model for Video Stability
    Kou, Tengchuan
    Liu, Xiaohong
    Sun, Wei
    Jia, Jun
    Min, Xiongkuo
    Zhai, Guangtao
    Liu, Ning
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1066 - 1076
  • [29] No-reference artifacts measurements based video quality metric
    Vranjes, Mario
    Bajcinovci, Viliams
    Grbic, Ratko
    Vajak, Denis
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 78 : 345 - 358
  • [30] No-Reference Video Quality Assessment Based on Three-Dimensional Convolutional Neural Networks
    Zhang Shufang
    Guo Zhipeng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (07)