Conformer Based No-Reference Quality Assessment for UGC Video

被引:0
|
作者
Yang, Zike [1 ]
Zhang, Yingxue [1 ]
Si, Zhanjun [1 ]
机构
[1] Tianjin Univ Sci & Technol, Coll Artificial Intelligence, Tianjin 300457, Peoples R China
来源
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VI, ICIC 2024 | 2024年 / 14867卷
关键词
video quality assessment; Conformer; UGC video;
D O I
10.1007/978-981-97-5597-4_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the lack of reference videos and complex distortions, video quality assessment (VQA) for user-generated content (UGC) has become a highly challenging task. Previous studies have fully demonstrated the effectiveness of deep learning models in UGC VQA, but most methods only use a single CNN or Transformer to extract features, without fully integrating the advantages of them. In this paper, we propose a no-reference video quality assessment method based on Conformer, which utilizes convolutional neural networks and self-attention mechanisms in parallel to obtain features more suitable for UGC video quality. A Feature Attention (FA) module is further proposed to help the model focus on important parts of the video. The experimental results show that the proposed model achieves good performance on mainstream subjective UGC video quality databases, indicating the effectiveness on UGC VQA.
引用
收藏
页码:464 / 472
页数:9
相关论文
共 50 条
  • [1] ATTENTION BASED NETWORK FOR NO-REFERENCE UGC VIDEO QUALITY ASSESSMENT
    Yi, Fuwang
    Chen, Mianyi
    Sun, Wei
    Min, Xiongkuo
    Tian, Yuan
    Zhai, Guangtao
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1414 - 1418
  • [2] A Deep Learning based No-reference Quality Assessment Model for UGC Videos
    Sun, Wei
    Min, Xiongkuo
    Lu, Wei
    Zhai, Guangtao
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022,
  • [3] No-reference model for video quality assessment based on SVM
    Wu, Lili
    Yu, Chunyan
    ADVANCES IN MECHATRONICS, AUTOMATION AND APPLIED INFORMATION TECHNOLOGIES, PTS 1 AND 2, 2014, 846-847 : 1024 - 1030
  • [4] A No-Reference Video Quality Assessment Metric Based On ROI
    Jia, Lixiu
    Zhong, Xuefei
    Tu, Yan
    Niu, Wenjuan
    IMAGE QUALITY AND SYSTEM PERFORMANCE XII, 2015, 9396
  • [5] A NO-REFERENCE VIDEO QUALITY ASSESSMENT BASED ON LAPLACIAN PYRAMIDS
    Zhu, Kongfeng
    Hirakawa, Keigo
    Asari, Vijayan
    Saupe, Dietmar
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 49 - 53
  • [6] Reconstruction-based No-Reference Video Quality Assessment
    Wu, Zhenyu
    Hu, Hong
    PROCEEDINGS OF THE 2016 IEEE REGION 10 CONFERENCE (TENCON), 2016, : 3075 - 3078
  • [7] An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysis
    Mukesh Kumar Rohil
    Neetika Gupta
    Prakash Yadav
    Signal, Image and Video Processing, 2020, 14 : 205 - 213
  • [8] No-Reference Video Shakiness Quality Assessment
    Cui, Zhaoxiong
    Jiang, Tingting
    COMPUTER VISION - ACCV 2016, PT V, 2017, 10115 : 396 - 411
  • [9] An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysis
    Rohil, Mukesh Kumar
    Gupta, Neetika
    Yadav, Prakash
    SIGNAL IMAGE AND VIDEO PROCESSING, 2020, 14 (01) : 205 - 213
  • [10] COME for No-Reference Video Quality Assessment
    Wang, Chunfeng
    Su, Li
    Zhang, Weigang
    IEEE 1ST CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2018), 2018, : 232 - 237