No-reference quality assessment for contrast-altered images using an end-to-end deep framework

被引:3
|
作者
Hu, Shiyong [1 ]
Yan, Jia [1 ]
Zhang, Weixia [1 ]
Deng, Dexiang [1 ]
机构
[1] Wuhan Univ, Elect Informat Sch, DSPs Lab, Wuhan, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
contrast alteration; image quality assessment; convolutional neural network; image representation; end-to-end training; STATISTICS;
D O I
10.1117/1.JEI.28.1.013041
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
No-reference image quality assessment (NR-IQA) aims to predict image quality consistently with subjective scores with no prior knowledge of reference images. However, contrast distortion, which is an uncommon distortion, has been largely overlooked. To address this issue, we explore the NR-IQA metric by predicting the quality of contrast-altered images, using deep-learning techniques. We adopt a two-stage training strategy due to a gap between the deep learning's sample requirements and the insufficiency of samples in the IQA domain. A deep convolutional neural network (CNN) is first designed and is pretrained to the classification task with the help of an additional synthetic contrast-distorted dataset. Then, the pretrained CNN is fine-tuned on the target IQA dataset using an end-to-end training approach. An effective pooling method is employed to map the image representation into a subjective quality score during the fine-tuning stage. Experimental results on five public IQA databases containing contrast-altered images show that the proposed method achieves competitive results and has good generalization ability compared to other NR-IQA methods. (C) 2019 SPIE and IS&T
引用
收藏
页数:13
相关论文
共 50 条
  • [21] DVC: An End-to-end Deep Video Compression Framework
    Lu, Guo
    Ouyang, Wanli
    Xu, Dong
    Zhang, Xiaoyun
    Cai, Chunlei
    Gao, Zhiyong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10998 - 11007
  • [22] No-Reference Quality Assessment for Multiply Distorted Images based on Deep Learning
    Sang, Qingbing
    Wu, Lixiu
    Li, Chaofeng
    Wu, Xiaojun
    2017 INTERNATIONAL SMART CITIES CONFERENCE (ISC2), 2017,
  • [23] End-To-End Learning for Action Quality Assessment
    Li, Yongjun
    Chai, Xiujuan
    Chen, Xilin
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 125 - 134
  • [24] A novel end-to-end deep learning framework for skin lesion segmentation and classification in clinical images
    He, X.
    Wang, Y.
    Zhao, S.
    Chen, X.
    JOURNAL OF INVESTIGATIVE DERMATOLOGY, 2022, 142 (08) : S52 - S52
  • [25] End-to-end Quality of Service Framework for Heterogeneous Networks
    Baldi, Mario
    Giacomelli, Riccardo
    2009 IFIP/IEEE INTERNATIONAL SYMPOSIUM ON INTEGRATED NETWORK MANAGEMENT - WORKSHOPS, 2009, : 245 - 248
  • [26] Hematoma expansion prediction in intracerebral hemorrhage patients by using synthesized CT images in an end-to-end deep learning framework
    Yalcin, Cansu
    Abramova, Valeriia
    Terceno, Mikel
    Oliver, Arnau
    Silva, Yolanda
    Llado, Xavier
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2024, 117
  • [27] An End-to-End Framework for Joint Denoising and Classification of Hyperspectral Images
    Li, Xian
    Ding, Mingli
    Gu, Yanfeng
    Pizurica, Aleksandra
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) : 3269 - 3283
  • [28] End-to-end security assessment framework for connected vehicles
    Evans, David
    Calvo, Daniel
    Arroyo, Adrian
    Manilla, Alejandro
    Gomez, David
    2019 22ND INTERNATIONAL SYMPOSIUM ON WIRELESS PERSONAL MULTIMEDIA COMMUNICATIONS (WPMC), 2019,
  • [29] An End-to-End Framework for the Classification of Hyperspectral Images in the Wood Domain
    Confalonieri, Roberto
    Htun, Phyu Phyu
    Sun, Boyuan
    Tillo, Tammam
    IEEE ACCESS, 2024, 12 : 38908 - 38916
  • [30] End-to-End Deep Diagnosis of X-ray Images
    Urinbayev, Kudaibergen
    Orazbek, Yerassyl
    Nurambek, Yernur
    Mirzakhmetov, Almas
    Varol, Huseyin Atakan
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 2182 - 2185