Deep unsupervised nonconvex optimization for edge-preserving image smoothing

被引:0
作者
Xiong, Yiwen [1 ]
Yang, Yang [1 ]
Zeng, Lanling [1 ]
Wang, Xinyu [1 ]
Pan, Zhigeng [2 ]
Jiang, Lei [1 ]
机构
[1] Jiangsu Univ, Dept Comp Sci, Zhenjiang, Jiangsu, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Artificial Intelligence, Nanjing, Peoples R China
关键词
computational imaging; edge-preserving; image smoothing; unsupervised learning;
D O I
10.1117/1.JEI.33.4.043001
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Edge-preserving image smoothing plays a vital role in the field of computational imaging. It is a valuable technique that has applications in various tasks. However, different tasks have specific requirements for edge preservation. Existing filters do not take into account the task-dependent smoothing behavior, resulting in visually distracting artifacts. We propose a flexible edge-preserving image filter based on a nonconvex Welsch penalty. Compared with the convex models, our model can better handle complex data and capture nonlinear relationships, thus providing better results. We combine deep unsupervised learning and graduated nonconvexity to solve our nonconvex objective function, where the main network structure is designed as a Swin transformer complemented with the locally enhanced feed-forward network. Experimental results show that the proposed method achieves excellent performance in various applications, including image smoothing, high dynamic range tone mapping, detail enhancement, and edge extraction. (c) 2024 SPIE and IS&T
引用
收藏
页数:14
相关论文
共 37 条
[1]   An L1 Image Transform for Edge-Preserving Smoothing and Scene-Level Intrinsic Decomposition [J].
Bi, Sai ;
Han, Xiaoguang ;
Yu, Yizhou .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (04)
[3]   Fast Image Processing with Fully-Convolutional Networks [J].
Chen, Qifeng ;
Xu, Jia ;
Koltun, Vladlen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2516-2525
[4]  
Durand F, 2002, ACM T GRAPHIC, V21, P257, DOI 10.1145/566570.566574
[5]   A General Decoupled Learning Framework for Parameterized Image Operators [J].
Fan, Qingnan ;
Chen, Dongdong ;
Yuan, Lu ;
Hua, Gang ;
Yu, Nenghai ;
Chen, Baoquan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) :33-47
[6]   Edge-preserving decompositions for multi-scale tone and detail manipulation [J].
Farbman, Zeev ;
Fattal, Raanan ;
Lischinski, Dani ;
Szeliski, Richard .
ACM TRANSACTIONS ON GRAPHICS, 2008, 27 (03)
[7]   LIME: Low-Light Image Enhancement via Illumination Map Estimation [J].
Guo, Xiaojie ;
Li, Yu ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :982-993
[8]   Robust Guided Image Filtering Using Nonconvex Potentials [J].
Ham, Bumsub ;
Cho, Minsu ;
Ponce, Jean .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (01) :192-207
[9]   Guided Image Filtering [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (06) :1397-1409
[10]   Fast Cost-Volume Filtering for Visual Correspondence and Beyond [J].
Hosni, Asmaa ;
Rhemann, Christoph ;
Bleyer, Michael ;
Rother, Carsten ;
Gelautz, Margrit .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (02) :504-511