Exploring Contrast Multi-Attribute Representation With Deep Network for No-Reference Perceptual Quality Assessment

被引:0
作者
Yang, Xiaodong [1 ,2 ]
Han, Zhenqi [1 ]
Wang, Yedong [3 ,4 ]
Liu, Lizhuang [1 ]
Zhao, Dan [1 ]
机构
[1] Chinese Acad Sci, Shanghai Adv Res Inst, Shanghai 201210, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Ocean Univ China, Qingdao 266005, Peoples R China
[4] Hisense Elect Informat Grp R&D Ctr, Qingdao 266100, Peoples R China
基金
中国国家自然科学基金;
关键词
Measurement; Histograms; Databases; Distortion; Semantics; Feature extraction; Training; Image quality assessment; contrast-changed images; perceptual attributes; deep network; DISTORTED IMAGES; ENHANCEMENT;
D O I
10.1109/LSP.2022.3158593
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Aiming at the effectiveness of contrast feature design, we proposed a promising novel non-reference quality assessment approach in exploring Attribute-Based representation. The method generates three perceptual attribute categories tailored to contrast. The first is semantic attribute derived from deep convolutional neural network, which implements adaptive contrast prediction relevant to scenario content. Second, for perceiving Spatial channel attribute, the global and local features generated by dark channel map through the designed dual convolution structures. Third, for statistical attribute, we assume the enhanced image as "reference" and calculate the structural similarity with pristine image, and the entropy and histogram metrics are also employed to assist learning. After that, for maximizing utilization, the features are embedded and integrated hierarchically to translate into objective score. In addition, a medium-scale contrast distortion database is established to support further research, which is more challenging than existing datasets because of the sufficient content and sophisticated changes. We demonstrate the availability of structures quantitatively and verify the rationality of hypothesis. Extensive experiments reveal that the proposed method outperforms advanced methods and achieves the state-of-the-art on the created database and CSIQ, TID2013, CCID2014.
引用
收藏
页码:902 / 906
页数:5
相关论文
共 30 条
  • [1] Contrast enhancement of brightness-distorted images by improved adaptive gamma correction
    Cao, Gang
    Huang, Lihui
    Tian, Huawei
    Huang, Xianglin
    Wang, Yongbin
    Zhi, Ruicong
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2018, 66 : 569 - 582
  • [2] No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics
    Fang, Yuming
    Ma, Kede
    Wang, Zhou
    Lin, Weisi
    Fang, Zhijun
    Zhai, Guangtao
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (07) : 838 - 842
  • [3] DeepSim: Deep similarity for image quality assessment
    Gao, Fei
    Wang, Yi
    Li, Panpeng
    Tan, Min
    Yu, Jun
    Zhu, Yani
    [J]. NEUROCOMPUTING, 2017, 257 : 104 - 114
  • [4] Gu HN, 2015, IEEE INT SYM BROADB
  • [5] Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data
    Gu, Ke
    Tao, Dacheng
    Qiao, Jun-Fei
    Lin, Weisi
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) : 1301 - 1313
  • [6] No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization
    Gu, Ke
    Lin, Weisi
    Zhai, Guangtao
    Yang, Xiaokang
    Zhang, Wenjun
    Chen, Chang Wen
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (12) : 4559 - 4565
  • [7] The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement
    Gu, Ke
    Zhai, Guangtao
    Lin, Weisi
    Liu, Min
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (01) : 284 - 297
  • [8] Gu K, 2013, IEEE IMAGE PROC, P383, DOI 10.1109/ICIP.2013.6738079
  • [9] Single Image Haze Removal Using Dark Channel Prior
    He, Kaiming
    Sun, Jian
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) : 2341 - 2353
  • [10] KonIQ-10k: An Ecologically Valid Database for Deep Learning of Blind Image Quality Assessment
    Hosu, Vlad
    Lin, Hanhe
    Sziranyi, Tamas
    Saupe, Dietmar
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4041 - 4056