No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

被引:0
作者
Xu, Kepeng [1 ]
He, Gang [1 ]
Qiao, Tong [1 ]
Liu, Zhenyang [1 ]
机构
[1] Xidian Univ, Xian, Peoples R China
来源
PROCEEDINGS OF THE 3RD WORKSHOP ON QUALITY OF EXPERIENCE IN VISUAL MULTIMEDIA APPLICATIONS, QOEVMA 2024 | 2024年
关键词
Image Quality Assessment; Neural Network;
D O I
10.1145/3689093.3689184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the processes of image capture, transmission, processing, and storage, distortions are inevitable, degrading image quality and affecting both perception and information retrieval. Therefore, assessing image quality is crucial. Current deep learning-based no-reference image quality assessment (NR-IQA) methods face challenges: they fail to preserve both local sensitivity and global details through down-sampling, struggle with multi-scale feature extraction across various distortion types, and lack semantic content perception. Addressing these, we propose the Local and Global Multi-scale Feature (LGMF) algorithm for NR-IQA. This method introduces a grid-based random down-sampling module preserving both local and global details, a pyramid vision Transformer for multi-scale feature extraction, and a global semantic prior extraction module enhancing semantic content perception. Further, a cross-attention feature fusion module selectively integrates these elements, significantly improving quality assessments. The LGMF model also functions as a quality-aware loss function, guiding image restoration networks to achieve superior objective and subjective restoration results. Tested across six datasets, LGMF consistently outperforms existing NR-IQA methods, demonstrating superior generalization and effectiveness in image restoration tasks.
引用
收藏
页码:21 / 29
页数:9
相关论文
共 43 条
  • [1] Target-Based Attention Model for Aspect-Level Sentiment Analysis
    Chen, Wei
    Yu, Wenxin
    Zhang, Zhiqiang
    Zhang, Yunye
    Xu, Kepeng
    Zhang, Fengwei
    Fan, Yibo
    He, Gang
    Yang, Zhuo
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 259 - 269
  • [2] Ghadiyaram Deepti, 2015, Live in the wild image quality challenge database
  • [3] Gong HY, 2024, Arxiv, DOI arXiv:2404.13677
  • [4] Film-GAN: towards realistic analog film photo generation
    Gong, Haoyan
    Su, Jionglong
    Seng, Kah Phooi
    Nguyen, Anh
    Liu, Ao
    Liu, Hongbin
    [J]. NEURAL COMPUTING & APPLICATIONS, 2024, 36 (08) : 4281 - 4291
  • [5] SDRTV-to-HDRTV via Hierarchical Dynamic Context Feature Mapping
    He, Gang
    Xu, Kepeng
    Xu, Li
    Wu, Chang
    Sun, Ming
    Wen, Xing
    Tai, Yu-Wing
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2890 - 2898
  • [6] FM-VSR: Feature Multiplexing Video Super-Resolution for Compressed Video
    He, Gang
    Wu, Shan
    Pei, Simin
    Xu, Li
    Wu, Chang
    Xu, Kepeng
    Li, Yunsong
    [J]. IEEE ACCESS, 2021, 9 : 88060 - 88068
  • [7] KonIQ-10k: An Ecologically Valid Database for Deep Learning of Blind Image Quality Assessment
    Hosu, Vlad
    Lin, Hanhe
    Sziranyi, Tamas
    Saupe, Dietmar
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4041 - 4056
  • [8] Blind Image Quality Assessment via Deep Learning
    Hou, Weilong
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (06) : 1275 - 1286
  • [9] Convolutional Neural Networks for No-Reference Image Quality Assessment
    Kang, Le
    Ye, Peng
    Li, Yi
    Doermann, David
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1733 - 1740
  • [10] Most apparent distortion: full-reference image quality assessment and the role of strategy
    Larson, Eric C.
    Chandler, Damon M.
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2010, 19 (01)