Image Blur Classification and Unintentional Blur Removal

被引:6
作者
Huang, Rui [1 ,2 ]
Fan, Mingyuan [3 ]
Xing, Yan [1 ]
Zou, Yaobin [2 ]
机构
[1] Civil Aviat Univ China, Coll Comp Sci & Technol, Tianjin 300300, Peoples R China
[2] China Three Gorges Univ, Hubei Key Lab Intelligent Vis Based Monitoring Hy, Yichang 443002, Peoples R China
[3] SACH, Key Res Ctr Surface Monitoring & Anal Cultural Re, Tianjin 300350, Peoples R China
关键词
Blur detection; blur classification; deblurring; blur removal; CAMERA;
D O I
10.1109/ACCESS.2019.2932124
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Blur is a general image degradation caused by low-quality cameras or intentional photographing for highlighting moving or salient objects. However, most blur classifiers just classify images into blur and sharp, which cannot distinguish the intentional blurred images from the unintentional blurred ones. Some unintentional blurred images are too valuable to discard directly. In this paper, we propose a robust image blur classifier to classify images into sharp, intentional blur, and unintentional blur. The basic idea of identifying the blur of a pixel being intentional or unintentional is that whether the blur occurs on a salient and semantic meaningful object. This inspired us to employ cues of blur, saliency, and semantic segmentation. We use spatial pyramid pooling to extract global features. Then, a random forest is used to conduct classification. We further detect the unintentional blur pixels by incorporating the cues into a conditional random field (CRF). The intentional blur image can be generated by pasting the deblurred unintentional blur regions back to the blur image. We conduct image blur classification on UBICD dataset and unintentional blur removal on different types of unintentional blur images. The experimental results show superior performance of image blur classification and the promising results of unintentional blur removal of our method.
引用
收藏
页码:106327 / 106335
页数:9
相关论文
共 46 条
  • [1] [Anonymous], 1995, P 3 INT C DOCUMENT A
  • [2] [Anonymous], 2006, P NEURAL INFORM PROC
  • [3] Framelet-Based Blind Motion Deblurring From a Single Image
    Cai, Jian-Feng
    Ji, Hui
    Liu, Chaoqiang
    Shen, Zuowei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (02) : 562 - 572
  • [4] Analyzing Spatially-varying Blur
    Chakrabarti, Ayan
    Zickler, Todd
    Freeman, William T.
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 2512 - 2519
  • [5] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848
  • [6] Global Contrast Based Salient Region Detection
    Cheng, Ming-Ming
    Mitra, Niloy J.
    Huang, Xiaolei
    Torr, Philip H. S.
    Hu, Shi-Min
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (03) : 569 - 582
  • [7] CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
  • [8] The blur effect: Perception and estimation with a new no-reference perceptual blur metric
    Crete, Frederique
    Dolmiere, Thierry
    Ladret, Patricia
    Nicolas, Marina
    [J]. HUMAN VISION AND ELECTRONIC IMAGING XII, 2007, 6492
  • [9] Fan RE, 2008, J MACH LEARN RES, V9, P1871
  • [10] Removing camera shake from a single photograph
    Fergus, Rob
    Singh, Barun
    Hertzmann, Aaron
    Roweis, Sam T.
    Freeman, William T.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (03): : 787 - 794