Learning in-place residual homogeneity for single image detail enhancement

被引:7
作者
Jiang, He [1 ,2 ,3 ]
Asad, Mujtaba [1 ,2 ]
Huang, Xiaolin [1 ,2 ,3 ]
Yang, Jie [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Dept Automat, Shanghai, Peoples R China
[2] Minist Educ China, Key Lab Syst Control & Informat Proc, Shanghai, Peoples R China
[3] Shanghai Jiao Tong Univ, Inst Med Robot, Shanghai, Peoples R China
关键词
detail enhancement; in-place residual homogeneity; fast in-place searching; example-based; SUPERRESOLUTION;
D O I
10.1117/1.JEI.29.4.043016
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
An image detail enhancement algorithm is proposed based on in-place residual homogeneity (IP). Residual homogeneity is a physical law, which mainly explains the texture similarity between the same image residual at slightly different resolutions. As we all know, a single image can be divided into a base layer and a detail layer, and the effective estimation of the detail layer is the key in a detail enhancement algorithm. In the experiment, we find that the residual layer of an image obtained by bilinear interpolation is closely related to its detail layer, hence it can be used as the initial estimation of the detail layer, then residual homogeneity is applied to update the residual layer until the accurate detail layer is acquired. In the process of updating residuals, a searching method called fast in-place searching (FIPS) is used. FIPS only takes advantage of the residual homogeneity within the in-place region, which accelerates the project about 93%. Different from the local-based and global-based methods, our IP gets the detail layer directly and amplifies it. It has many good properties, such as being fast, edge-aware, robust, and parameter-free. Good performance has been demonstrated on several widely used datasets by both subjective and objective evaluations. (C) 2020 SPIE and IS&T
引用
收藏
页数:19
相关论文
共 41 条
[1]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[2]   Contour Detection and Hierarchical Image Segmentation [J].
Arbelaez, Pablo ;
Maire, Michael ;
Fowlkes, Charless ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) :898-916
[3]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[4]   Structure-Preserving Guided Retinal Image Filtering and Its Application for Optic Disk Analysis [J].
Cheng, Jun ;
Li, Zhengguo ;
Gu, Zaiwang ;
Fu, Huazhu ;
Wong, Damon Wing Kee ;
Liu, Jiang .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (11) :2536-2546
[5]  
Deng Y., 2018, ACM MULT C
[6]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[7]   Diffusion Maps for Edge-Aware Image Editing [J].
Farbman, Zeev ;
Fattal, Raanan ;
Lischinski, Dani .
ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (06)
[8]   Edge-preserving decompositions for multi-scale tone and detail manipulation [J].
Farbman, Zeev ;
Fattal, Raanan ;
Lischinski, Dani ;
Szeliski, Richard .
ACM TRANSACTIONS ON GRAPHICS, 2008, 27 (03)
[9]   Participating Media Illumination Using Light Propagation Maps [J].
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (01)
[10]   Adaptive Manifolds for Real-Time High-Dimensional Filtering [J].
Gastal, Eduardo S. L. ;
Oliveira, Manuel M. .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04)